Robust Web Automation

Problem statement: LinkedIn is becoming more stringent on their website being automated by making their site more automation unfriendly. towards that step - they started performing class obfuscating class names with some hash code / random strings

https://github.com/AIHawk-FOSS/Auto_Jobs_Applier_AI_Agent/pull/957

https://medium.com/geekculture/bypass-scraping-websites-that-has-css-class-names-change-frequently-d4877ecd6d8f shared by feder-cr

Note: Ask AI - share html element code, ask AI to what rely on for making it robust.

List of interactions -> way to take

get_jobs_form_page()-> 1. Find easy apply inside <ul>, find all ul, (which is wrapped with scrolable parent), What if there are many? ->

alternate -> position: static, flex, flex direction

---

job_tile_to_job() -> we populate job object-based UI must -> we need job link -> find visible <a>, extract title & link for that we need title -> "" we need company -> is Easy Apply -> search for "visible" string Easy Apply

other thigs: location we need

---

this work has been discontinued due to aggressive actions of LinkedIn

Email from LinkedIn

---

Hi XXXXXXXXXXX,

LinkedIn Support instructed you to reach out to LinkedIn's Enforcement Team due to your violations of the LinkedIn User Agreement in connection with your use, or, if applicable, participation in development, of the AIHawk software. These violations include activity covered in the User Agreement's “Don’ts” section, which expressly prohibits the following, among other things:

8.2.2: Developing, supporting or using software, devices, scripts, robots or any other means or processes (such as crawlers, browser plugins and add-ons or any other technology) to scrape or copy the Services, including profiles and other data from the Services;

8.2.3: Overriding any security feature or bypassing or circumventing any access controls or use limits of the Services (such as search results, profiles, or videos);

8.2.4: Copying, using, displaying or distributing any information (including content) obtained from the Services, whether directly or through third parties (such as search tools or data aggregators or brokers), without the consent of the content owner (such as LinkedIn for content it owns);

8.2.13: Using bots or other unauthorized automated methods to access the Services, add or download contacts, send or redirect messages, create, comment on, like, share, or re-share posts, or otherwise drive inauthentic engagement;

8.2.17: Violating LinkedIn’s Professional Community Policies, which prohibit using LinkedIn invitations to send unwelcome communications to people who don’t know you or who are unlikely to recognize you as a known contact, inviting people you do not know to join your network, and sending spam.

Your account will remain restricted until we are able to confirm to our satisfaction that you have ceased violating the User Agreement. As we have previously stated when contacted regarding account restrictions due to use and/or development of AIHawk, the most straight forward method to provide us with this confirmation is the cessation of all use and/or development of the software by all of its users and/or developers in any form that violates the User Agreement, and all data collected from LinkedIn by these parties must be deleted. We of course remain open to other evidence that you in particular have ceased violating the User Agreement but your personal attestation that you no longer use the software, or, if applicable, participate in its development, will, on its own, be insufficient to enable us to restore access to your account.

While your account remains restricted, we understand you may wish to continue using LinkedIn. However, we discourage you from attempting to circumvent the restrictions of your account by creating any new accounts with your real name, or with a fake name. Such activity is a violation of Section 2.1(2) of the LinkedIn User Agreement also requires that you “have one LinkedIn account, which must be in your real name,” and any such accounts you may create will be restricted upon discovery and may result in permanent restriction of this account even if your other violations cease.

This notice is not intended by LinkedIn, and should not be construed by you, as a waiver or relinquishment of any of LinkedIn’s rights or remedies, all of which LinkedIn specifically reserves.

Enforcement Team LinkedIn Corporation

---