Data Engineer
Encora Inc.
hace 2 días

Responsibilities :

  • Build and maintain multiple data pipelines to ingest new data sources (APIs, Files, Streaming, Databases,Email, etc.) and support products used by both external users and internal teams
  • Optimize infrastructure and pipelines by building DataOps tools to evaluate and automatically monitordata quality, auto-scale serverless infrastructure, and develop data-driven pipelines
  • Work with our data science and product management teams to design, rapidly prototype, and productize new internal and external data product ideas and capabilities
  • Work with the data engineering team to migrate and enhance our existing Pentaho-based ETL pipelineto a new Python-based system and develop a serverless cloud data lake to augment our existingSnowflake Data Warehouse
  • Conquer complex problems by finding new ways to solve with simple, efficient approaches with focus onreliability, scalability, quality and cost of our platforms
  • Build processes supporting data transformation, data structures metadata, and workload management
  • Collaborate with the team to perform root cause analysis and audit internal and external data and processes to help answer specific business questions
  • Requirements

  • Bachelor’s degree in Computer Science or related field of study
  • 2+ years of data engineering experience or education equivalency
  • SQL and Python skills including knowledge of Python libraries / frameworks
  • Experience with AWS tools including EMR / Athena, S3, Kinesis, API Gateway, LAMBDA, Athena, etc.
  • Excellent troubleshooting and problem-solving skills
  • Excellent communication and teamwork, and a passion to learn
  • Familiarity with distributed computing platforms (e.g. Hadoop, Spark, Storm)
  • In the order of importance :

  • SQL - Expert level Experience (Using MPP DB like Snowflake, Redshift, Vertica Prefered)
  • ETL - Intermediate level Experience (Extract transform load) Tools (Either On-Prem and SaaS tools)
  • Data Modeling - Intermediate level Experience
  • Python - Intermediate level Experience
  • AWS - Intermediate level Experience
  • Reportar esta oferta

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    Mi Correo Electrónico
    Al hacer clic en la opción "Continuar", doy mi consentimiento para que neuvoo procese mis datos de conformidad con lo establecido en su Política de privacidad . Puedo darme de baja o retirar mi autorización en cualquier momento.
    Formulario de postulación