DataOps: Enhancing Data Management for Big Data and Analytics.
Keywords:
DataOps, Big Data, Analytics, Data Management, Continuous IntegrationAbstract
Given the increase in "big data" & the need for "actionable analytics," it's getting harder to deal with data. CI/CD (continuous integration and delivery of data) & Data Ops (which was built on DevOps) make it easier to work with data by encouraging teamwork.Data Ops improves data quality, speed, and reliability by coordinating teams across the data flow. Regarding the end, this helps companies get clean, useful data faster, which helps them make better choices. It works great in places with a lot of info that can't handle it with normal methods. Keeping track of all the different systems, making sure everything is legal and safe & getting people to accept change are all problems. This means that you can still use Data Ops to improve tracking & scaling, even with these issues. This way makes workflows better for big data. This makes handling data more efficient & lets businesses use their data to get ahead of the competition.
References
1. Pinkel, C., Schwarte, A., Trame, J., Nikolov, A., Bastinos, A. S., & Zeuch, T. (2015). DataOps: seamless end-to-end anything-to-RDF data integration. In The Semantic Web: ESWC 2015 Satellite Events: ESWC 2015 Satellite Events, Portorož, Slovenia, May 31–June 4, 2015, Revised Selected Papers 12 (pp. 123-127). Springer International Publishing.
2. Bonacorsi, D., Wildish, T., Kuznetsov, V., & Giommi, L. (2015). Exploring patterns and correlations in CMS Computing operations data with Big Data analytics techniques. PoS, 008.
3. Gorton, I., Yin, J., Akyol, B., Ciraci, S., Critchlow, T., Liu, Y., ... & Vlachopoulou, M. (2013, January). Gridoptics (tm) a novel software framework for integrating power grid data storage, management and analysis. In 2013 46th Hawaii International Conference on System Sciences (pp. 2167-2176). IEEE.
4. Yin, J., Gorton, I., & Poorva, S. (2012, November). Toward real time data analysis for smart grids. In 2012 SC Companion: High Performance Computing, Networking Storage and Analysis (pp. 827-832). IEEE.
5. Tech, B. (2015). Cloud Computing. SlideShare Site: https://www. slideshare. net/ranjanravi33/cloud-computing-46478251.
6. O’Brien, J., & Wiand, R. (2008). Rapid, Global Communication of Company Policies and Standards. In The 2008 Annual Meeting.
7. McFarlane, A. M. G. H. D., & Thomas, K. P. (2015). Analytics on a Shoestring: Evolving the Requirements.
8. Arasteh, A. D., Mohammadpur, D., & Meghdadi, M. (2014). MapReduce Based Implementation of Aggregate Functions on Cassandra. International Journal of Electronics Communication and Computer Technology (IJECCT), 4(3), 2014.
9. Thomas, D. (2015, September). Think? Compute! See!! End User Programming for Thinkers. In EDOC (p. 38).
10. Allen, P. L., Gravseth, D. P., Huffman, M. B., Hughes, R. W., May, B. J., Nguyen, S. N., ... & Roderick, M. J. (2011). Ship-to-shore data communication and prioritization (Doctoral dissertation, Monterey, California. Naval Postgraduate School).
11. Belforte, O. B., De Roeck, A., Elmer, P., Hemmer, F., Innocente, V., Jank, W., ... & Yagil, A. (2006). A T0 Architecture for the CMS Experiment.
12. Kemppinen, O., Tillman, J. E., Schmidt, W., & Harri, A. M. (2013). New analysis software for Viking Lander meteorological data. Geoscientific Instrumentation, Methods and Data Systems, 2(1), 61-69.
13. Cabanillas Macías, C. (2012). Enhancing the Management of Resource-Aware Business Processes.
14. Yang, J. (2000). External, extensible transaction services for WWW-based collaborative systems. Columbia University.
15. Schlosser, M., del Rosal, L. F., Habel, K., CTTC, M. S. M., CTTC, J. M. F., TID, V. L., ... & FUJITSU, T. T. (2014). Deliverable D2. 1 Requirements analysis of technology enablers for the flexi-grid optical path-packet infrastructure for Ethernet transport.
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
