GigaOm hosted their Structure Big Data Conference in New York City on March 23rd and it was a great event. They put on some of the best focused, content rich conferences I attend. What surprised many folks at the conference was the large Austin contingent. Big Data has long been thought of a a Wall Street issue (hedge funds tracking in real time every tick of every stock for as far back as possible) and more recently the consumer web giants – Google, Facebook, Yahoo!, etc. (think of a database the scale of FB or an entry for every server log entry associated with FB, that is internet big data). None of those are associated with Austin, yet we have a rapidly growing leadership position in the space.
At the conference were:
- Pervasive - a global data innovation leader delivering software to manage, integrate, and analyze data in the cloud or on-premises throughout the entire data life cycle.
- MomentumSI - provides application development and systems implementations that incorporate disruptive technologies. We are at the forefront of Cloud Computing, DevOps, BPM and SOA.
- DataStax (formerly Riptano) - commercial leader in Apache Cassandra™ that is leveraging this next-generation data platform that evolved from work at Google, Amazon and Facebook to make it easy for customers to build, deploy and operate elastically scalable and cloud-optimized applications and data services.
- Calxeda – a processor platform for hyperscale servers that will allow data centers to slash IT costs and energy consumption by as much as a factor of 10. Calxeda is a very successful ATI alumni company.
- InfoChimps – a place to find, sell and share data with others through data sets or data APIs.
- Ravel – provides the tools to rapidly discover and integrate knowledge from disconnected data. Their KnowledgeStream and GoldenOrb products are used by company consultants and clients to acquire, transform, integrate, and utilize large data sets from enterprise databases and web sources. Ravel recently became a member of ATI’s Wireless & IT incubator.
- Spiceworks - IT pros use Spiceworks to do their jobs and learn about the products and services they need to make IT happen
The Austin community has developed in this area based on the work done by several folks, with a few notables: Lynn Bender (Geek Austin), Steve Watt (Hadoop Austin who is now with HP after leading IBM Big Sheets), and Juan Sequeda (Semantic Web Austin). If you want to learn more about big data, check out and engage with these organizations. Austin’s contingent was core to the current conversation of Hadoop, but was also leading the conversation on the emerging technologies of Cassandra, which emerged from Facebook (DataStax), and Pregal, which emerged from Google (Ravel). InfoChimps had stage time to talk about the commercial value of data via its marketplace and Calxeda got a reference from none other than Andy Bechtolsheim, co-founder of Sun Microsystems. Andy also drove home the need for new data storage solutions and basically described Eonsil, a current ATI member company.
Look for more national leadership in this space from Austin and thank you to all of those who have worked so hard to push our community to this point.