I have a Java file designed to scrape data from the London Tribunals website. However, the program is no longer functioning, and I suspect the issue lies with handling session cookies or authentication.
The task is to:
Diagnose the issue with session cookies or any related authentication mechanisms. Fix the code to ensure it can connect to the website and retrieve data successfully. Test the program end-to-end to confirm it works as expected with the website's current structure. Ensure that data is properly saved into a CSV file.
Requirements: Experience in web scraping using Java. Familiarity with handling cookies and maintaining session states (e.g., using HttpClient or similar libraries). Understanding of HTML structure and parsing using libraries like JSoup. Ability to troubleshoot and debug Java code.
I will provide: The existing Java file. Example HTML or structure of the target pages (if needed). Details about the data points to extract.
Deliverables: A fully functional Java program that successfully extracts data from the website. A detailed explanation of the changes made to the code. Clear instructions on how to run the program.
