WHAT WE DO
Data Products:
The building blocks to data valorization
Explicitly address your data consumers' desires
Throughout recent years, data product thinking for data is emerging. Rather than just doing something with data, Data Products focus on fulfilling the needs of your data consumers, while balancing with feasibility and viability.
Building Data Products still happens with Data Engineers writing Data Pipelines, and that is still what we do best at Dataminded. Yet we have also focussed on delivering value and adding to purpose throughout our existence. That is why we are firm believers and proud implementers of data products.
What is a data product?
For Dataminded, a data product is the data and everything you need to use it. Because in the end, making sure that someone uses the results of our data pipelines, is what we are aiming for. What consumers need to use the data, can be quite broad:
The data itself: without data, no data usage.
Metadata descriptions to make sure people know what the data is all about
Data access: again, without access, no usage
Data contracts and SLA's to allow consumers to trust the data
Business logic induced in coded, because yes, also:
Code building data pipelines
We are data engineers, writing code is what we do, but our data engineers will assist you to keep all of the above in mind and help you grow to a mature data product company.
A look under the hood of data products.
Engineering
A data engineer induces business logic in a data product by writing code while following best practices. This includes adopting software design principles, version control, automated testing, CI/CD, Cloud-Native, and DevSecOps practices.
As data engineers, we build custom data pipelines for complex use cases. For more common use cases we provide self-service solutions. We are an enabler in an organization. Over the years we have seen the rise of domain-specific languages and drag-and-drop tools. Nothing has come close to the expressiveness and adoption of SQL. We see it as the bridge to enable less technical profiles and we favor it as the interface in self-service solutions.
Public cloud providers have drastically changed the playing field of data engineering over the last few years. They have increased flexibility while lowering the operational burden. There are still valid exception scenarios but cloud is the new default.
Consistency is a powerful weapon yet there is no golden hammer. For each use case, we try existing “boring” technologies first, rather than selecting a technology to expand our own knowledge and experience. We will use bleeding edge technology when we have good reason to do so.
Operations
Data product governance
Governing Data Products being build across your entire organization, can be quite challenging. We strongly believe that technology can help you manage your Data Products. We are main contributors to the open source project Data Product Portal, which provides you with an overview of existing Data Products and manages the processes around them.
Ready to build your first data product?
Does data product thinking seems to be the next step in your data maturity journey? Don't hesitate to get in touch!