ACADEMIC DATA ENGINEER
- Location: Durham, NC
- Posted: Jul 13, 2019
The Office of Information Technology manages Dukes central technology infrastructure and provides services and applications to support the educational and research missions of the institution, as well as the university's business functions.
OIT works with key campus constituents to develop IT strategic planning; provides applications and services ranging from e-mail to wireless connectivity to server hosting; supports departments and individuals with help via the OIT Service Desk, online self-help and training; and supplies a communications infrastructure to support advanced network, voice and Web services.
University-wide working groups developed a strategic plan for information technology at Duke that included three primary goals:
Provide an enabling technology infrastructure for ubiquitous and convenient access to computing and communications capabilities, facilitating the daily work of faculty, students and staff.
Extend our effectiveness in our distributed environment by facilitating collaboration among departments and, in critical areas, between departments and the central IT infrastructure.
Enrich the teaching, learning and research environment at Duke by providing faculty and students with IT resources and services that are easy to use, well-matched to their needs, and contribute effectively to the achievement of Duke's institutional goals.
Position: Academic Data Engineer and Instructor
Duke University seeks an outstanding Academic Data Engineer and Instructor who will (a) facilitate new research projects through the creative integration of multiple data sources, (b) inspire students with the power of data engineering and (c) function as a central member of an emerging Data Analytics Practice at Duke that stimulates new uses of data analytics in instruction and research. As an integral part of Dukes Data Science community, the staff member will be expected to work closely with faculty, students, and other departments at Duke. The staff member should be passionate about engineering ways to use new types of data to solve world problems, detail-oriented, and self-motivated to learn new skills and subjects as technology changes.
The staff member will have a central role in working with faculty to identify and leverage commonalities in support of new data-intensive degree programs (Dukes Masters in Interdisciplinary Data Science (MIDS)) and other academic programs, both in the physical classroom and as online courses. Together with personnel and support from Dukes Office of Information Technology , the staff member will be part of a growing team focused on data analytics, and will bring to that team an emphasis on academic data analytics.
The staff members responsibilities would include:
Working with academic faculty to monitor and optimize current forms of data collection, and develop and integrate new forms of data collection
Working with academic faculty to optimize the transformation of collected data into formats appropriate for analysis
Working with academic faculty and IT developers to apply stateof-the-art approaches in cloud service, containerization and other techniques for scaling the remote staging, storage, computation and analysis of data sets, including at scale by hundreds or thousands of students in online courses
Providing expertise in data set hygiene to the institution, facilitating the cleanup and integration of potentially multiple incomplete, irregular, and partial data sources into interesting and useful data sources for analysis
Working with various offices to ensure that information is used complies with the regulatory and security policies in place
Teaching a Database Systems core course for the MIDS program and possibly other programs
Helping develop advanced courses in Data Engineering
Developing and running workshops for the campus community in different aspects of data management and wrangling
Advising student capstone projects in the MIDS and other programs on data engineering needs
Helping evaluate capstone projects with program faculty
To meet these responsibilities, the candidate should be an innovative problem solver, team-focused, highly organized, have the ability to handle-multiple and simultaneous tasks, and demonstrate an ability to stay calm and focused in emergencies. The candidate should also enjoy working in collaborative relationships, and have an approachable and relatable demeanor that inspires trust and confidence in partners.
Masters degree in mathematics, statistics, computer science or related field or equivalent experience. Doctorate preferred.
At least 5 years of working experience as a database engineering support personnel or a database engineering administrator within a fast-paced, complex setting.
The applicant must have expertise in the following areas:
distributed computing principles
legacy and modern database architectures
Hadoop-based technologies (e.g. MapReduce, Hive and Pig)
SQL-based technologies (e.g. PostgreSQL and MySQL)
NoSQL technologies (e.g. Cassandra and MongoDB)
Streamprocessing systems (e.g. Storm or Spark-Streaming)
ETL tools and APIs
optimizing data storage and retrieval for specific use cases
testing and validating the accuracy of data transformations
cloud computing architectures, preferably with specific expertise in Microsoft Azure and AWS
programming in multiple programming languages, including Python and Java
Due to the applicants role interacting with students, faculty, and staff on projects, the applicant must also be able to demonstrate skills in:
Creative problemsolving that is sensitive to available time and resource constraints
Effective listening and communication
Duke University and Durham are located in the Research Triangle, a region that encompasses one of the nation's premier concentrations of academic, corporate, and public research. The Triangle region is rated among the most desirable areas in North America to live and work and has been identified by Money magazine as one of the "Best Places to Live" in the U.S.
Trustworthiness, respect, diversity, learning and teamwork are the hallmarks of Duke's guiding principles. Our accomplishments are dependent on the dedication and expertise of all who work to support Duke's mission.
Duke University is an Affirmative Action/Equal Opportunity Employer committed to providing employment opportunity without regard to an individual's age, color, disability, gender, gender expression, gender identity, genetic information, national origin, race, religion, sex, sexual orientation, or veteran status.
Duke aspires to create a community built on collaboration, innovation, creativity, and belonging. Our collective success depends on the robust exchange of ideasan exchange that is best when the rich diversity of our perspectives, backgrounds, and experiences flourishes. To achieve this exchange, it is essential that all members of the community feel secure and welcome, that the contributions of all individuals are respected, and that all voices are heard. All members of our community have a responsibility to uphold these values.
Essential Physical Job Functions: Certain jobs at Duke University and Duke University Health System may include essential job functions that require specific physical and/or mental abilities. Additional information and provision for requests for reasonable accommodation will be provided by each hiring department.