OdometerCollecting User Data

Project Details
Project DateMarch 2015

Odometer is the big data component of the Octane platform. It is a simple script that you embed on a site which will collect clickstream data for each user that visits the dealer's site.

Before starting on this, I had only done a little work with MongoDB with very few entries. Odometer has millions of entries and I needed to run large queries with analysis. I ended up using the built-in Mongo functions, MapReduce and Aggregation, to run the queries and analyse the data in one task. The output data was saved separately, so I can query it for the front end later on. I learned a lot about the internals on Mongo and how its indexes work, which sped up the queries in a very noticeable way.

Categories NodeJS, Angular, HTML/CSS, Javascript, MongoDB