v0.1.1

Release Notes for sub-link-extractor v0.1.1

Bug Fix:

• Fix bug to extract only lower url based on sourceURL

v0.1.0

Release Notes for sub-link-extractor v0.1.0

New Features:

1. Deep Link Extraction:

Our DefaultLinkExtractor now doesn't just extract links from the provided webpage but goes a step further by exploring each of the links recursively to extract links from subpages as well.
It ensures comprehensive coverage, providing a more in-depth extraction process than ever before.

2. No More Duplicate URLs:

The updated extractor ensures that the list of URLs returned doesn't contain any duplicates, thereby eliminating redundancy and ensuring a cleaner output.

3. Robots.txt Compliance:

The extractor is now more respectful to websites. It adheres to the Disallow rules from the robots.txt file of the target domain, ensuring that it doesn't crawl pages that website administrators want to be left alone.

4. Efficiency Enhancements:

Significant improvements in memory management and search speed have been achieved, providing a smoother user experience.

5. Support for Relative URLs:

The extractor now efficiently handles relative URLs, converting them to absolute ones, ensuring that no links are missed in the extraction process.

6. Handling of URLs with Hash Tags:

URLs pointing to the same webpage, but having different hash tags, are now considered as one. This ensures that the extractor doesn't revisit the same page multiple times, leading to increased efficiency.

Other Improvements:

• Refactored the library for better maintainability by using an interface-based strategy pattern.
• Enhanced error handling for potential issues that might arise during link extraction.

Breaking Changes:

• The static method LinkExtractor.extractLinks() is now replaced with an instance method. Users need to create an instance of DefaultLinkExtractor to use the extractLinks() method.

v0.0.2

Ensure that only lower url is extracted

v0.0.1

Update build.gradle