CPW Data Engineer II

COMPANY OVERVIEW We exist to make food the world loves. But we do more than that. Our company is a place that prioritizes being a force for good, a place to expand learning, explore new perspectives and reimagine new possibilities, every day. We look for people who want to bring their best — bold thinkers with big hearts who challenge one another and grow together. Because becoming the undisputed leader in food means surrounding ourselves with people who are hungry for what’s next.​ 
 OVERVIEW Cereal Partners Worldwide (CPW) is a joint venture between General Mills and Nestlé, two of the world’s leading food organizations. Working at CPW offers the best of both worlds: the scale and capabilities of large organizations combined with the agility and entrepreneurial spirit of a smaller company. CPW builds cutting-edge capabilities, sets industry benchmarks, partners with technology start-ups, implements advanced processes, and creates strong technical and analytical foundations. This is an opportunity to learn, grow, and contribute to an exciting, data-driven team. KEY ACCOUNTABILITIES Build high-quality data assets that provide a competitive advantage. Develop and maintain robust ETL/ELT pipelines using Azure Databricks and PySpark. Design and maintain Bronze, Silver, and Gold data-layer architectures. Implement incremental processing, deduplication, data validation, and performance optimization. Establish and maintain data governance and stewardship practices, including data quality, security, validation metrics, and accurate data flow. Integrate data from multiple sources, including Nielsen, Circana, internal systems, panel data, RMS data, and other relevant datasets. Develop scalable data models to support reporting, analytics, and business intelligence use cases. Ensure consistency across product, period, market, and other business hierarchies. Review existing data models and processes to identify sustainable, scalable, and automated approaches. Harmonize data and processes while maintaining an effective balance between speed, quality, and business needs. Partner with stakeholders and internal teams to understand data requirements and deliver timely solutions to business questions. Support reporting and visualization teams with backend data architecture and data model development. Optimize queries, Delta storage formats, pipelines, workflows, scalability, and cost efficiency. Identify and resolve data-quality issues and proactively address data opportunities. Maintain strong working relationships with peers and contribute effectively as a team member.

Bachelor’s degree in Computer Science, Information Technology, Electronics and Telecommunications, or a related field. Minimum 7 years of relevant experience in Data Engineering. Mandatory experience working with data lakes and multiple data sources. Strong hands-on experience with - SQL , PySpark,   Azure Databricks , Azure Data Factory. Knowledge of data warehousing concepts, ETL frameworks, and business intelligence platforms. Experience with Delta Lake architecture and large-scale data processing. Strong understanding of data modeling, data integration, and data quality principles. Good communication and stakeholder-management skills.

Master’s degree in Computer Science, Information Technology, Electronics and Telecommunications, or a related field. Experience in the FMCG industry. Experience developing business intelligence platforms or 360-degree data views. Experience with Nielsen, Circana, panel data, RMS data, or similar consumer and market datasets. Experience with Azure Storage Accounts, Azure Key Vault, and Azure DevOps. Familiarity with data governance, data security, and stewardship frameworks. Strong focus on data accuracy, reliability, and attention to detail. Ability to manage ambiguous data issues and drive timely resolution. Continuous-improvement and ownership mindset. Ability to lead change, make