GreenwichRecruiter Since 2001
the smart solution for Greenwich jobs

Data Engineer

Company: The Atlantic Group
Location: Greenwich
Posted on: May 1, 2021

Job Description:

Our client, a mid-size global investment firm with over 40B in capital, is looking to hire 2 Data Engineers (junior and senior both welcome) to finish building out their new team! The firm has presence in both NYC and CT. In this role, you would be required to spend at least 1 dayweek in Greenwich, CT. JOB FUNCTIONS The Senior Data Engineer will be part of the strategic cloud data engineering team, responsible for conducting the firm's data engineering efforts. The role is focused on the development of performant data pipelines and architectures on the alternative data team. The Senior Data Engineer will work closely with data engineers, data analysts, data scientists, and other developers to help build and extend Vikingrsquos significant data platform. Responsibilities bull Build and maintain robust data pipelines that ingest TBs of data. bull Build new Airflow DAGs that manage different operators or individual tasks. bull Create logical and physical data models for big data to be stored in cloud data warehouses. bull Optimize Spark and SQL queries. bull Create new SQL tables for reports and dashboards. bull Work with data warehouses Snowflake, AWS Redshift, and other cloud data warehouses. bull Work with data analysts on implementing dashboards and performing analysis. bull Use Databricks Spark and data visualization tools to analyze business problems. bull Generate reports and dashboards for business insights. bull Write analytical queries to extract insights for large datasets (billions of rows, multi-TB in size). QUALIFICATIONS bull A minimum of 8 years of relevant work experience. bull A degree or advanced degree in Computer Science, Engineering, Physics, Mathematics, Statistics, or Machine Learning, with a record of academic success. bull Excellent development experience in Python, Apache Spark, and SQL. bull Extensive experience with large-scale data processing solutions. bull Extensive working knowledge of Apache Spark, Databricks and pandas. bull Extensive working experience with AWS ecosystem. bull Excellent computer science fundamentals and problem-solving skills. bull Strong ability to work in Linux environment. bull Experience in the fields of data warehousing, business intelligence and big data related technologies. bull Experience in creating logical and physical data models. bull Experience with one or more cloud MPP data warehouses including Snowflake, AWS Redshift, Azure Data Warehouse (Synapse), or Google BigQuery. The ideal candidate will also have bull Experience with JavaScala or C++ bull Familiarity with machine learning libraries and applications bull Experience with object relational modeling frameworks (SQLAlchemy, DJango) bull Strong understanding of Docker and containerization

Keywords: The Atlantic Group, Greenwich , Data Engineer, Engineering , Greenwich, Connecticut

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category

Log In or Create An Account

Get the latest Connecticut jobs by following @recnetCT on Twitter!

Greenwich RSS job feeds