Data Engineering Mastermind

We're looking for bright Data Engineer Masterminds to join our team At Critical TechWorks, we're not just engineering software; we're sculpting the data landscape of tomorrow. Our Data Engineers are pivotal in transforming the BMW Group into a data-driven powerhouse. From handling vast datasets to optimizing data flows, you will be at the forefront of innovation in automotive technology. Data Pipeline Development:Design and maintain robust data pipelines, ensuring seamless data flow from various sources to storage and analytical platforms. Data Modeling:Craft and optimize data models for efficient data retrieval and analysis, balancing performance and scalability. Data Quality Assurance:Implement rigorous testing and validation protocols to guarantee the accuracy and integrity of data. Troubleshooting and System Optimization:Proactively identify and solve data processing issues, enhancing the performance and reliability of data systems. Big Data Processing:Engage in large-scale data projects, utilizing frameworks like Apache Spark for efficient data handling and processing. Real-Time Data Streaming:Work on cutting-edge projects that process and analyze data in real-time, ensuring swift data delivery and insights. Whatever you're working on, here's the lowdown on the technical skills you're likely to have: At least 3 years of experience in data engineering. Experience working with public cloud platforms, especially AWS. Experience withIaC tools, such as Terraform. Ability to code in at least one programming language(Python, Java, JavaScript, Scala) is a must. Experience working with and creating data-driven architectures, preferably in public cloud platforms. Experience using a querying language such asSQL. Experience with Big Data and datamodelling. Advanced knowledge of multiple SQL/noSQL data environments and a strong. understanding of why and when to use a particular solution. Familiarity with tools in the Big Data ecosystem(like Hadoop, Cassandra, Apache Hive, Apache Spark, and others alike). Experience with orchestration toolslike Airflow is a big plus. CTW's Daily Toolkit Apart from great technical skills, our environment is fast-paced and 100% agile, and prioritizes autonomy, teamwork, interaction and resilience. This means our Data Engineersmust alsopossess the following: Embrace agileand its implementation frameworks namelyScrum, to make the most out of all its events and work to keep evolving a high-performing team. Be available to be a cross-functional teammember by using and developing new skills and enabling a fully responsible team able to cover the whole product lifecycle. Use standard software engineering practices and tools likeversion control, IDEs, data dashboards, to manage and keep a systematic and organized development process. Use state of the art DevOps quality practicesand tools such as Continuous Integration /Continuous Deployment(CI/CD)pipelines to build, analyse, perform automated testing and deployment processes, to ensure a streamlined and reliable development workflow. Run and operate developed software inside and outside working hoursif needed, to provide high quality software services (extra compensation will be applicable). Be available to travelabroad for short periods, as required to support all the phases of the product development cycle when needed. Haveexcellent English oral and written skills.German communication skills will be a plus. Who we are Critical TechWorks seeks a distinct and treasured corporate culture, that is very much our own. This means: Growth and Innovation:Be a key player in shaping the future of mobility through innovative ideas. Engineering Excellence:Immerse yourself in an environment valuing engineering process, where we create, innovate, lead, and make a tangible impact. Autonomy and Collaboration:Thrive in a culture that blends autonomy with teamwork, contributing to groundbreaking developments. Continuous Learning:Embrace constant skill enhancement in a dynamic workplace, where your contributions impact cutting-edge technology projects. Join Critical TechWorks on our journey of innovation, excellence, and redefining the future of motion, one product at a time. At Critical Techworks we are creating an inclusive culture that values our people's different viewpoints and experiences, regardless of sexual orientation, gender identity, age, color, ethnicity, religion, or disability.