Hadoop to MySQL Data Moving Crane Goes Open Source | Database Journal

Hadoop to MySQL Data Moving Crane Goes Open Source

Jun 30, 2010
1 minute read

Planning to move into open source is Twitter’s Crane, a tool built by Twitter to move data from MySQL to Hadoop, as well as the HBase distributed database, other MySQL databases, and more. According to Twitter analytics man, Kevin Wiel, seven terabytes of data goes into Hadoop a day with Crane handling tabular data, and almost everything done on Twitter ends up in a MySQL table somewhere.

Database Journal Logo

DatabaseJournal.com publishes relevant, up-to-date and pragmatic articles on the use of database hardware and management tools and serves as a forum for professional knowledge about proprietary, open source and cloud-based databases--foundational technology for all IT systems. We publish insightful articles about new products, best practices and trends; readers help each other out on various database questions and problems. Database management systems (DBMS) and database security processes are also key areas of focus at DatabaseJournal.com.

Property of TechnologyAdvice. © 2026 TechnologyAdvice. All Rights Reserved

Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.