Video: Migrating Big Data from A to B

Print Friendly, PDF & Email

In this video, Laura Thomson from Mozilla describes a major project involving Big Data Migration.

In January 2011 we moved the Mozilla crash reporting system from old creaky hardware in San Jose to a new shiny datacenter in Phoenix. This system contains more than 40TB of data in HBase, the Hadoop database, and PostgreSQL. The data collecting app has a requirement for close to 100% uptime. On top of that we have data processing, an API, and a webapp. After many months of work, the migration went seamlessly.

Recorded at the linux.conf.au on January 17, 2012.

Speak Your Mind

*