Overview
We are seeking a Market Intelligence Analyst with expertise in web crawling, data extraction, and competitive intelligence to join our BI team.
You will design and implement Python-based crawlers to collect, analyze, and derive actionable insights from search engines, social media platforms, app stores, and industry news.
Your work will support strategic decision-making by monitoring brand sentiment, competitor activities, market trends, and regulatory changes.
Responsibilities
- Develop and maintain high-performance Python crawlers (using Selenium, Playwright, Scrapy, BeautifulSoup) to extract structured/unstructured data from:
- Search engines: brand-related queries
- App Stores: User reviews and ratings
- News/Forums: Industry trends, competitor announcements, policy updates
- Handle anti-scraping mechanisms and ensure data compliance
- Data Processing & Analysis
- Clean and preprocess raw data (e.g., deduplication, text normalization, sentiment tagging)
- Generate structured reports (dashboards/visualizations) to highlight key trends
- Monitor industry news, policy changes (e.g., fintech regulations), and competitor strategies
- Collaborate with cross-functional teams to align insights with business goals
Qualifications
- Must-Have
- Technical skills
- Proficient in Python
- Experience with web crawling
- Familiarity with data cleaning
- Analytical skills
- Ability to translate raw data into actionable insights
- Strong problem-solving skills and attention to detail
- Basic knowledge of NLP is a plus
- Background in social media analytics is a plus
Seniority level
Employment type
Job function
- Research and Strategy/Planning
Industries
- Desktop Computing Software Products
- IT System Custom Software Development
We’re unlocking community knowledge in a new way.
Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr