Spectacular Data Engineering Lead (**Mid Level and Above)

Arlington, VA

Full Time

Mid Level

Black Cape

Job Title: Data Engineering Lead

Location: Arlington, Falls Church, Crystal City, Alexandria or Pentagon, VA

Employment Type: Full-time

ONSITE: Ability to go ONSITE Up to 2-5 days per week (depending on customer needs)

Clearance: Active TS/SCI required - no CI Poly but need to be willing to get one

***MUST HAVE an Active TS/SCI Clearance****

**Need to be OPEN to sitting for a CI Poly**

***Be able to flex in and out of SCIFs at Pentagon, Crystal City, Alexandria and Falls Church***

About the Project:

We are delivering a large-scale data platform initiative for a DoD client, involving a 50-person cross-functional team of data engineers, BI developers, product owners, and domain experts. Our infrastructure is built on Databricks for data processing and transformation, and Qlik for analytics and reporting.

We are seeking a Data Engineering Lead to lead the data engineering workstream—ensuring high-quality, scalable, and efficient data solutions that enable timely insights and business decision-making.

Role Overview:

The Data Engineering Lead will oversee the design, development, and maintenance of the project’s data pipelines, data models, and integrations. This role involves both technical leadership and people management—guiding a team of engineers, setting priorities, and ensuring successful delivery in alignment with the project’s goals and timelines.

We are expanding and need to hire motivated data engineers to help build innovative solutions for our customers. The ideal candidate needs limited direction and to be passionate about technology. A willingness and desire to pick up new technologies or languages quickly is a must.

Our team builds and deploys cutting-edge AI and Machine Learning applications that directly support national security missions. We leverage the Databricks platform for advanced data science and engineering, and transform complex model outputs into compelling, interactive dashboards using Qlik.

These solutions are built to empower 19 key Principal Staff members (Senior Executive Service members and General Officers) within the Office of the Undersecretary of Defense (OUSD) and the Intelligence community. Our products provide them with the critical, data-driven insights needed for strategic decision-making.

Our work is grounded in successful deployments on JWICS, NIPR, SIPR utilizing AWS, combining commercial best practices in an Agile environment to ensure we deliver impactful capabilities to senior defense leadership.

Key Responsibilities

Leadership & Management:

Lead and manage a team of Data Engineers working on Databricks-based data processing workflows
Coordinate closely with developers, Qlik specialists, and other project leads to align technical outputs with reporting requirements
Oversee sprint planning, backlog management, and milestone tracking
Mentor engineers and promote best practices for coding, testing, and deployment

Technical Oversight:

Design and maintain scalable data pipelines using Databricks
Ensure data quality, lineage, and governance across ingestion, transformation, and consumption layers
Optimize Databricks clusters and jobs for performance and cost efficiency
Integrate with Qlik data models to ensure seamless dashboard performance

Collaboration & Stakeholder Engagement:

Work with project managers to define scope, deliverables, and timelines
Partner with product owners and Qlik developers to ensure transformed data meets analytical needs
Act as a technical point of contact for client stakeholders, communicating risks, trade-offs, and progress

Quality & Compliance:

Implement robust testing and validation for all data pipelines
Ensure compliance with data security and privacy requirements
Maintain documentation for data flows, transformations, and system dependencies

Qualifications:

Required (MUST HAVES)

5+ years in data engineering, with at least 2 years in a team lead or manager role
Hands-on experience with Databricks
Strong knowledge of data modeling and transformation for BI tools, preferably Qlik. Tableau would be acceptable
Proficiency in cloud platforms (AWS preferred) and related data services; if no AWS experience, we can consider Azure or GCP (Google Cloud Platform) experience
Track record of delivering complex data projects on time and within budget
Experience managing data engineering workstreams in a multi-team project (35+ people)
Familiarity with CI/CD for data workflows and version control (e.g., Git)
Working knowledge with JIRA and Confluence; some previous experience preferred
Experience working in an Agile delivery in a data project context
Customer-interfacing experience in the Federal sector preferred; working professionally across many cross-functional teams
Team Player ALL THE WAY!

Preferred (NICE to HAVES)

Experience managing data engineering workstreams in a multi-team project (60+ people)
Experience with Jupyter Notebooks or Familiarity with it

What We Offer:

Opportunity to lead a high-impact project with modern data infrastructure
Work alongside a skilled, multidisciplinary team(s)
We help manage the mission; You manage your time and Team; Black Cape Offers a Lot of Autonomy to Our Leaders, because we hire well

About the Company:

Want to be a part of a LOYAL, Intelligent, Talented, Dynamic & FUN Team from the ground up and help build something GREAT??

Then, you should consider Us!
We work with the Intelligence Community and Department of Defense to accomplish their goals!
Come join us in creating cloud-native web applications, advanced data analysis tools, and new machine learning capabilities

Be a part of a team that is making an IMPACT on the world and its safety and HAVE FUN while doing so!

Black Cape is a unique technology company with a focus on Machine Learning, AI, Cloud and BIG Data work and Services and Products positioned for Federal Government customers and some Commercial Customers.

Black Cape is a company developed by Proven Success Stories.

Former successful companies of these Founders supported many programs as both a prime and a subcontractor and created a strong reputation working with top tier partners, in every major Intelligence Agency and the Department of Defense.

We are a COOL and FUN crew that works hard and plays maybe even a little harder!! Our Core Team is an impressive bunch with exceptional leadership at the helm!

Black Cape provides full-stack software development and software integration capabilities for traditional, cloud, and hybrid-cloud environments.

We are doing AI technology, Machine Learning and Cloud technology- that will IMPACT the greater good and the world's safety!!

CONTACT: [email protected] to learn MORE!

Apply for this position

Required*

Apply with

First Name*

Last Name*

Email Address*

Phone*

Address

Resume*

We've received your resume. Click here to update it.

Attach resume or Paste resume

Attach resume as .pdf, .doc, .docx, .odt, .txt, or .rtf (limit 5MB) or Paste resume

Paste your resume here or Attach resume file

Are you 18 years of age or older?

LinkedIn Profile URL:*

Do you have US Citizenship?*

Do you have a Secret Security Clearance issued by a US Government Agency?*

Do you have a Top Secret Security Clearance issued by a US Government Agency?*

Do you have a TS/SCI Security Clearance issued by a US Government Agency?*

If you have at minimum a Secret Clearance, are you willing and able to get a TS/SCI clearance and sit for a CI Polygraph?*

The following questions are entirely optional.

To comply with government Equal Employment Opportunity and/or Affirmative Action reporting regulations, we are requesting (but NOT requiring) that you enter this personal data. This information will not be used in connection with any employment decisions, and will be used solely as permitted by state and federal law. Your voluntary cooperation would be appreciated. Learn more.

Gender

Race/Ethnicity

Invitation for Job Applicants to Self-Identify as a U.S. Veteran

A “disabled veteran” is one of the following:
- a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or
- a person who was discharged or released from active duty because of a service-connected disability.
A “recently separated veteran” means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.
An “active duty wartime or campaign badge veteran” means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.
An “Armed forces service medal veteran” means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Veteran status

I IDENTIFY AS ONE OR MORE OF THE CLASSIFICATIONS OF PROTECTED VETERAN LISTED ABOVE
I AM NOT A PROTECTED VETERAN
I DON’T WISH TO ANSWER

Voluntary Self-Identification of Disability

Voluntary Self-Identification of Disability Form CC-305
OMB Control Number 1250-0005
Expires 04/30/2026

Why are you being asked to complete this form?

We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five years.

Completing this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more about the law or this form, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at www.dol.gov/ofccp.

How do you know if you have a disability?

A disability is a condition that substantially limits one or more of your “major life activities.” If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to:

Alcohol or other substance use disorder (not currently using drugs illegally)
Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDS
Blind or low vision
Cancer (past or present)
Cardiovascular or heart disease
Celiac disease
Cerebral palsy
Deaf or serious difficulty hearing
Diabetes
Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders
Epilepsy or other seizure disorder
Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome
Intellectual or developmental disability
Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD
Missing limbs or partially missing limbs
Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports
Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS)
Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities
Partial or complete paralysis (any cause)
Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema
Short stature (dwarfism)
Traumatic brain injury

Please check one of the boxes below:

YES, I HAVE A DISABILITY, OR HAVE HAD ONE IN THE PAST NO, I DO NOT HAVE A DISABILITY AND HAVE NOT HAD ONE IN THE PAST I DO NOT WANT TO ANSWER

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.

You must enter your name and date
Name	Date

Human Check*

Submit Application

Thanks for visiting our Career Page. Please review our open positions and apply to the positions that match your qualifications.