I'm currently a big data systems software architect at Yahoo!. I joined the company via the acquisition of a startup, BrightRoll where I started and led the big data engineering group. My role focused on technology, architecture, technical strategy and execution with the objective of enabling data driven capabilities for the company. We built a highly scalable platform (data pipelines, analytics, data warehouses) that ingests 10s of Terabytes of data per day and processes 10s of Billions of events per day. The major technologies used are Flume, HDFS, M/R, HBase, MySQL, Druid, Redshift, Play Framework, Scala, Java, Ruby.
I advise startups in terms of assessing and tackling their technical challenges, aligning their technology with business priorities, and finding a balance between premature optimization and scalability bottlenecks. I provide specific expertise relating to ad tech, big data, architecture, distributed and highly scalable systems, databases, infrastructure and lean/agile execution. Lastly, I provide introductions to investors and other industry experts where appropriate.
