Skip to content

test: fix tests for fetch node with proper mock&refactor #379

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jun 13, 2024

Conversation

iamgodot
Copy link
Contributor

@iamgodot iamgodot commented Jun 13, 2024

#354 made the tests for fetch node kinda pointless, this pr fixes that and also simplifies other tests.

BTW, line 137 in fetch_node.py seems a bit odd:

title, minimized_body, link_urls, image_urls = cleanup_html(source, source)

Feels like the first source should be the content read from the source, but I've not looked other modules yet so I'm not sure. Anyway let me know if that needs fix as well @VinciGit00

@VinciGit00 VinciGit00 merged commit 9dd2a63 into ScrapeGraphAI:pre/beta Jun 13, 2024
Copy link

🎉 This PR is included in version 1.7.0-beta.6 🎉

The release is available on:

Your semantic-release bot 📦🚀

@VinciGit00
Copy link
Collaborator

hi, it was almost perfect and we had to change path dir, if you can it could be helpful to make the tests fr the other nodes!

@iamgodot
Copy link
Contributor Author

Sure, I'll see what I can do

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants