• Junior Big Data Engineer

    Location
    US-NY-Yonkers
    Experience (Years)
    5
  • Position Overview

    We are seeking a highly skilled data engineer to join us in building a business intelligence data systems from ground up. The engineer will design and establish the analytics database; The engineer will analyze various internal and external data sources and develop the data pipelines and ETLs to feed the databases systematically using modern Data-Engineering technologies.

    Qualifications Include

    • Experience as a Data Engineer or related specialty (e.g., Software Engineer, Business Intelligence Engineer, Data Scientist) with a track record of manipulating, processing, and extracting value from large and complex datasets. 
    • Strong knowledge of DBMS concepts with hands-on experience architecting and deploying Nosql Databases (MongoDB), and working knowledge of Relational Databases (Oracle)
    • Strong scripting experience using Python/Bash in Linux/UNIX environment to process and analyze large data sets
    • Knowledge and Hands-on experience with object-oriented Programming languages and frameworks - Java/J2EE, Spring, in development for modern data engineering systems
    • Strong Knowledge and Hands-on experience in building ETL systems and data-pipelines.
    • Experience with technologies such as Apache Spark, Kafka, Flume, Sqoop is a big plus
    • Experience with data visualizations software (Tableau/Qlikview)
    • Experience with AWS technologies - EC2, S3, EMR, etc.
    • Experience working in projects involving building Data Warehouse, Data Lakes, Big data ecosystem (Hadoop, HDFS, Hive, and Hbase ) and Data Science is a plus
    • Experience working with modern tools in the Agile software development life cycle - Version Control Systems (Ex. git, github, Stash/BitBucket), Knowledge Management (Ex. Confluence, Google Docs), Development Workflow (Ex. Jira), Continuous Integration (Ex. Bamboo, Jenkins), Real Time Collaboration (Ex. Hipchat, Slack)

    Key Responsibilities

    • Design , Deploy, performance tune and monitor analytical databases
    • Design, Build, and Launch new data models , data pipelines and ETLs that ingest, map, aggregate, and broadcast data feeds to internal and external groups
    • Design, develop, and deploy various data visualizations
    • Analyze business requirements, provide development estimates and feedback, and determine implementation/execution approaches.
    • Work with other software engineers, database developers, infrastructure, operations and QA teams to design and implement quality software solutions
    • Support, troubleshoot, monitor and optimize existing data engineering systems
    • Help streamline software development by contributing to the implementation of a continuous integration process, automating manual processes, and eliminating defects
    • Performs other duties as assigned but not at a higher level

    Options

    Sorry the Share function is not working properly at this moment. Please refresh the page and try again later.
    Share on your newsfeed