designing and querying (“Big Data”) databases

1.Learning Objectives: The purpose of Project 4 is to enable the students to gain experience with new wave of NOSQL (Not Only SQL) technologies for designing and querying (“Big Data”) databases. After completing Project 3, a student is expected to become competent in using XML for DB design; as well as gain elementary understanding of such NOSQL techniques and underlying ideas, such as MapReduce, Hadoop, PageRank, Hash Tables, B-trees, KVP DBs, Document Stores, etc.

2.Do one of the following projects.

3.Choose oneof the 2 databases (DBs) you implemented in Project 1 – Project 3, (using ER model, RM model, SQL model: MySQL or SQLite), and re-design or re-engineer it into an XML database. Choose either DTD or XML Schema to specify the DB’s document schema.

4.Provide a DB Architecture that could potentially support the “Big Data” needs of a real-life institution or corporation. (Some suggestions are provided in Appendix A). Your design and architecture should include the following aspects, which will demonstrate that you have deeply thought about the issues involved and generated some insights:

·

·

·

5.Document and present your design as a reportin the following form:

Title

Author

Date, Revision Number

Problem to Solve

XML DB or “Big Data DB Design”. (Provide details in an Appendix)

Discussion

Summary & Conclusions

Acknowledgments, (if any)

References, (if any)

Appendix:

(a) XML DB

Cross-reference ER and RM DB design

Semi-structured Model design

Document schemas (DTD or XML)

XML DB details: graphs or networks, tables

(b)“Big Data” DB