Description

Description The Data Engineer Iis responsible for data collection, movement, storage, transformation processing, and storage ofBig Data. This individual works with both current ETL/Data Warehousing and future Big Data/Streaming/Pipeline architectures. The focus is on choosing optimal solutions to use for these purposes, then implementing, maintaining, and monitoring them, always being mindful of the overarching goal of accelerating translational research and improving clinical care. Responsibilities 1. Facilitates data collection from a variety of different sources, getting it in the right formats, assuring that it adheres to data quality standards, and assuring that downstream users can get that data quickly and with a common standard interface. 2. Ensures that data streams/pipelines are scalable, repeatable, and secure, and can serve multiple users within the Institute. 3. Develops as a core member of an Agile team, using Agile tools and methodology. Work closely with other team members including Application Developers, Database Developers, and Data Scientists. 4. Responsible for creating the infrastructure that provides ...