Journal
MACHINE LEARNING
Volume 57, Issue 1-2, Pages 83-113Publisher
SPRINGER
DOI: 10.1023/B:MACH.0000035473.11134.83
Keywords
data mining; data analysis; business intelligence; web analytics; web mining; OLAP; visualization; reporting; data transformations; retail; e-commerce; Simpson's paradox; sessionization; bot detection; clickstreams; application server; web logs; data cleansing; hierarchical attributes; business reporting; data warehousing
Categories
Ask authors/readers for more resources
The architecture of Blue Martini Software's e-commerce suite has supported data collection, data transformation, and data mining since its inception. With clickstreams being collected at the application-server layer, high-level events being logged, and data automatically transformed into a data warehouse using meta-data, common problems plaguing data mining using weblogs (e.g., sessionization and conflating multi-sourced data) were obviated, thus allowing us to concentrate on actual data mining goals. The paper briefly reviews the architecture and discusses many lessons learned over the last four years and the challenges that still need to be addressed. The lessons and challenges are presented across two dimensions: business-level vs. technical, and throughout the data mining lifecycle stages of data collection, data warehouse construction, business intelligence, and deployment. The lessons and challenges are also widely applicable to data mining domains outside retail e-commerce.
Authors
I am an author on this paper
Click your name to claim this paper and add it to your profile.
Reviews
Recommended
No Data Available