As a Data Engineer at Intapp, you will play a critical role in designing, building, and maintaining data pipelines and data loaders, as well as scraping data from various sources. You will ensure the quality, integrity, and availability of our data, which is essential for our data-driven decision-making processes.
What you will do:
- Develop, deploy, and maintain web scraping tools to gather data from targeted websites efficiently and reliably.
- Design and implement data scraping architectures that are scalable and robust.
- Design, develop, and maintain scalable and efficient data pipelines to ingest and process large volumes of data from diverse sources.
- Build and optimize data loaders to ensure seamless data integration and transformation.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
- Implement and maintain data quality checks to ensure the accuracy and consistency of data.
- Perform exploratory data analysis to identify trends, patterns, and insights.
- Stay up-to-date with industry best practices in web scraping, data analytics, and data privacy regulations.
What you will need:
- Strong programming skills in Python.
- Experience in building and deploying web scrapers using tools like Scrapy, Beautiful Soup, XPath, etc.
- Knowledge of parallel and distributed programming including load balancing, scalability, and concurrency
- Familiarity with data storage technologies like databases (SQL, NoSQL) and data formats (JSON, CSV, etc.)
- Problem-solving skills and attention to detail, ensuring accuracy and quality in scraped data.
- Strong communication skills to effectively convey findings and collaborate with team members.
Bonus if you have:
- Experience with data manipulation libraries (e.g., pandas, NumPy).
- Solid analytical skills with the ability to analyze complex datasets and extract actionable insights.
- Familiarity with Azure and their data services.
- Knowledge of data governance and data security best practices.
- Experience with containerization and orchestration tools (e.g., Docker, Kubernetes).
What you will get:
In return for your passion, commitment, and collaborative approach, we offer:
-
Competitive base salary plus variable compensation and equity
-
A flexible work environment
-
Generous paid parental leave, including adoptive leave
-
Traditional comprehensive benefits, plus:
-
Flexible Paid Time Off
-
Family Formation benefit offered by Carrot
-
Wellness programs and benefits provided by Modern Health
-
Paid volunteer time off and donation matching for the causes you care about
-
Opportunities for personal growth and professional development supported by a community of talented professionals
-
An open, collaborative environment where your background and contributions are valued
-
Experience at a growing public company where you can make an impact and achieve your goals
-
Open offices and break areas stocked with beverages and snacks
#Li-MT1
Intapp provides equal employment opportunities to all qualified applicants and will make hiring decisions without regard to race, color, sex, sexual orientation, gender identity or expression, religion, national origin or ancestry, age, disability, marital status, pregnancy, protected veteran status, protected genetic information, political affiliation, or any other characteristic protected by federal, state or local laws. All offers are contingent upon passing a criminal history and other background checks if applicable to the position.
Please note: Intapp will not hire through text message, social media, or email alone. We will never extend a job offer unless you have been contacted directly by an Intapp recruiter and have participated in the interview process which will generally consist of 3 or more virtual or in person meetings. Please note that Intapp only uses company email addresses, which contain “@intapp.com” or “@dealcloud.com” to communicate with candidates via email. Intapp will never ask for financial information of any kind or for any payment during the job application process. We post all legitimate job openings on the Intapp Career Site at https://www.intapp.com/working-at-intapp/
. If you believe you were a victim of such a scam, you may contact your local authorities. Intapp is not responsible for any claims, losses, damages, or expen