Big Data Architecture & Distributed Systems

Created 9 years ago in Technology / Software Development

I advise companies on big data architecture and on designing large scale platforms and services. The more / cheaper storage and computation choices we have, the more data we can process. However, many companies quickly become paralyzed when vast amounts of data are hurled at inadequate platforms. Designing solid and scalable architectures in-colo and in the cloud is critical for businesses to survive and thrive.

I've designed and built successful big data platforms and services for advertising, healthcare, financial services, and social networking - handling datasets of over 10 trillion transactions per month and tens to hundreds of thousands of dimensions. Many of these systems are real time or streaming and many provide off-line processing - when appropriate.

I care about optimizing the architectures *for the use cases they are supposed to solve* - i.e. falling in love with the problem, not the technology - and believe in short-term wins on the way to target state.

If you need advice on any of these topics, I'm happy to help.