Data Engineer
Job responsibilities: Responsible for data crawling, including static web pages, dynamic web pages (JS rendering), API interface data, etc; Handle anti crawling strategies such as User Agent impersonation, proxy pooling, captcha bypass, cookie encryption, body parameter encryption, etc., to improve crawling success rate; Parse web page data using XPath, CSS selectors, and syntax





