Skip to main content

Data Engineer at Quantum World Technologies Inc.

Data Engineer

Quantum World Technologies Inc.

Phoenix, AZmid5 hours ago

Full Timeonsite1-3Years
$226,599/year

Job Description

The Data Engineer will play a crucial role in designing, developing, and optimizing data pipelines to drive decision-making across the organization. This mid-level position focuses on ensuring seamless data integration and effective data modeling to support analytical initiatives, leveraging modern technologies and methodologies. In this role, you will engage in daily activities that include implementing ELT processes, utilizing Apache Iceberg for data management, and employing Apache Spark for distributed data processing. Proficiency in Python and Scala is essential for building robust ETL solutions, while experience with distributed SQL and RDBMS technologies will be vital for managing large datasets efficiently. You will be part of a collaborative team that values continuous learning and professional growth, offering opportunities to enhance your skills in cutting-edge technologies and methodologies. The environment encourages innovation and knowledge sharing, allowing you to advance your career in data engineering. This role is unique as it combines hands-on technical challenges with the opportunity to influence data strategy within the organization, making a direct impact on business outcomes.

Responsibilities

Design and implement data integration pipelines using Apache Spark and Python. Build scalable data models that support distributed SQL and data warehousing. Lead efforts in ETL processes to optimize data flow and storage efficiency. Architect solutions leveraging Apache Iceberg for high-performance data management. Drive the adoption of best practices in distributed data processing and ELT. Collaborate with teams to enhance RDBMS performance and data accessibility. Develop and maintain PySpark applications for real-time data analysis. Ensure data quality and consistency across multiple data sources and platforms.

Key Skills

Python
16%
Apache Spark
16%
ELT
11%
RDBMS
11%
Scala
11%

Benefits

Competitive salary with comprehensive health insurance and retirement plans. Flexible benefits package to support your health and financial needs. Generous paid time off policy to promote work-life balance. Remote work options available to enhance your lifestyle and productivity. Opportunities for professional development through training and workshops. Access to industry conferences and networking events for growth. Inclusive company culture that values diversity and teamwork. Fun office perks, including team-building activities and wellness programs.

Related Jobs