Discussion N
Career Relevancy
Understanding how enterprise date storage providers such as Google, Amazon Web Services, and Microsoft Azure can help you choose more efficient methods and technologies in your own data storage architecture.
Data and storage expansion are a challenging task for cloud service providers and data center managers. New technologies can be leveraged to implement storage back-ends, but when you have as much data growth as Google, sometimes you need to think out of the box. The Google File System uses many architecture concepts as RAID but pushes that up further into the OSI reference model by using software defined storage. This week we continue to explore a concept we started in NET424 and GFS. Google needed something better and evolve these concepts to Hadoop and MapReduce.
Subsection 1
Review the following video and learn more about how GFS concepts needed to be rethought to keep up with data needs.
Prompt
Research articles and videos on object storage devices and software defined storage ideas like Hadoop, Ceph or Data Lake designs. Discuss how these ideas and similar concepts have been able to deal with rapidly expanding storage needs found in data centers.
Your initial and reply posts should work to develop a group understanding of this topic. Challenge each other. Build on each other. Always be respectful but discuss this and figure it out together.
Reply Requirements