How do you view data governance and modeling in a big and fast data world?
- Seth Sanusi
- Mar 27, 2021
- 2 min read
Published on 2018-06-27 17:36 (LinkedIn: sethsanu)
Depending on who you ask there are three or more “V”’s of Big Data attributes: Volume, Velocity, and Variety (additionally Veracity, Value, Vicinity and any other pertinent V noun). Enterprise Data governance programs are set up to ensure the quality, safekeeping and optimal utilization of data. The principles of good data governance can be mapped to each “V” of big data:
· Volume: With larger amounts of structured and unstructured data being utilized, a data governance program should have a good inventory or both data and metadata. Dynamic data catalogs, data dictionaries and data profiles are becoming more commonplace in large scale data lakes just as they are in relational and analytical platforms.
· Velocity: As organizations ingest fast moving streams of data through IoT devices, social media and globally distributed applications, it’s important to manage the practicality of data in motion. Some consuming systems may need real time streams of data, while others may only require daily aggregations. Creating an understanding of how data is consumed by each application has value; do you know where your lambda architecture needs are?
· Variety: The schema of right now, may not be the same schema of tomorrow. The format of unstructured data may change, structured data platforms may migrate. Tools are available that can swiftly scan data for changes in structure and content and alert or adapt downstream data consumers. Well designed consuming systems are reactive and resolute to changing data with late binding schema designs or written for adaptability. The dashboard that consumes relational SQL data can be updated for Polybase queries against a data lake with little code churn.
There are additional governance considerations per industry, region and technology set. For a more comprehensive perspective, I highly recommend Sunil Soares's book "Big Data Governance: An Emerging Imperative" available from Amazon:
Their solar panel cleaning service was professional, affordable, and completed efficiently. The technicians removed built-up dust and debris carefully without causing any damage. It’s reassuring to find a company that understands proper cleaning techniques for delicate equipment while still delivering outstanding customer service and reliable appointment scheduling.
Their online counseling services are excellent for people with busy schedules who still need emotional support. Scheduling appointments was simple, and the virtual sessions felt private and comfortable. I appreciated the therapist’s thoughtful communication style and practical guidance, which helped me manage stress and improve my overall mental well-being gradually.
In the history of the NFL, few redemption arcs have been as dramatic—or as swift—as Saquon Barkley's. One year, he was the star running back the New York Giants couldn't bring themselves to pay. The next, he was hoisting the Lombardi Trophy with the hated rival Philadelphia Eagles, holding his daughter as confetti rained down, and etching his name into the record books as the most prolific single-season rusher the league has ever seen. Saquon Barkley Penn State Jersey
Flexible education opportunities make a construction management degree a popular option for individuals interested in construction leadership roles. Courses often focus on communication, workplace organisation, and project coordination. These valuable skills are useful across many industries.
To write about Chelsea Football Club is to trace the arc of modern football itself—a story of tradition abruptly intersecting with transformative wealth, leading to a relentless, often tumultuous, ascent to the summit of the game. Founded in 1905 in the affluent West London borough of Stamford Bridge, Chelsea long carried the air of the glamorous underachiever: a club with a famous home, a charismatic and celebrity-filled support, but a trophy cabinet that belied its stature. For decades, its identity was one of stylish flair and sporadic cup success, punctuated by the flamboyant sides of the 1960s and 70s. This all changed irrevocably on July 1, 2003, a date that marks the clearest "before and after" moment in football club…