reallignment #246
Merged
reallignment #246
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
docs: update instructions to use with LocalAI
Revert "docs: update instructions to use with LocalAI"
Docs main readme
…functionality for proxy rotation the broker has been made fully configurable for anonymity level, admissible locations, scheme and max shape not to waste resources, unlike the original `free-proxy` package. other options have been explored (e.g., `proxybroker`, `proxybroker2`) due to their built-in proxy server and rotation capabilities, but the former is no longer maintained, and the latter has issue with any python version outside of python 3.9
…eb driver with proxy protection and flexible kwargs and backend the original class prevents passing kwargs down to the playwright backend, making some config unfeasible, including passing a proxy server to the web driver. the new class has backward compatibility with the original, but 1) allows any kwarg to be passed down to the web driver, 2) allows specifying the web driver backend (only playwright is supported for now) in case more (e.g., selenium) will be supported in the future and 3) automatically fetches a suitable proxy if one is not passed already
…nto fix/fetch-node-proxybroker
…phore for parallel graph instances TODO: still untested
## [0.11.0-beta.11](v0.11.0-beta.10...v0.11.0-beta.11) (2024-05-14) ### Features * **omni-search:** added omni search graph and updated docs ([fcb3abb](fcb3abb)) * **gpt-4o:** image to text single node test ([90955ca](90955ca)) * **omni-scraper:** working OmniScraperGraph with images ([a296927](a296927)) ### Bug Fixes * **fetch_node:** bug in handling local files ([a6e1813](a6e1813))
## [0.11.0](v0.10.1...v0.11.0) (2024-05-14) ### Features * **parallel-exeuction:** add asyncio event loop dispatcher with semaphore for parallel graph instances ([627cbee](627cbee)) * **webdriver-backend:** add dynamic import scripts from module and file ([db2234b](db2234b)) * add gpt-4o ([52a4a3b](52a4a3b)), closes [#232](#232) * add new prompt info ([e2350ed](e2350ed)) * **proxy-rotation:** add parse (IP address) or search (from broker) functionality for proxy rotation ([2170131](2170131)) * add support for deepseek-chat ([156b67b](156b67b)), closes [#222](#222) * Add support for passing pdf path as source ([f10f3b1](f10f3b1)) * **omni-search:** added omni search graph and updated docs ([fcb3abb](fcb3abb)) * added proxy rotation ([0c36a7e](0c36a7e)) * **safe-web-driver:** enchanced the original `AsyncChromiumLoader` web driver with proxy protection and flexible kwargs and backend ([768719c](768719c)) * **gpt-4o:** image to text single node test ([90955ca](90955ca)) * revert fetch_node ([864aa91](864aa91)) * **batchsize:** tested different batch sizes and systems ([a8d5e7d](a8d5e7d)) * update info ([4ed0fb8](4ed0fb8)) * **omni-scraper:** working OmniScraperGraph with images ([a296927](a296927)) ### Bug Fixes * **pytest:** add dependency for mocking testing functions ([2f4fd45](2f4fd45)) * add json integration ([0ab31c3](0ab31c3)) * Augment the information getting fetched from a webpage ([f8ce3d5](f8ce3d5)) * bug for claude ([d0167de](d0167de)) * **fetch_node:** bug in handling local files ([a6e1813](a6e1813)) * **chromium-loader:** ensure it subclasses langchain's base loader ([b54d984](b54d984)) * fixed bugs for csv and xml ([324e977](324e977)) * limit python version to < 3.12 ([a37fbbc](a37fbbc)) * **proxy-rotation:** removed duplicated arg and passed the loader_kwarhs correctly to the node ([1e9a564](1e9a564)) * **fetch-node:** removed isSoup from default ([0c15947](0c15947)) * **proxy-rotation:** removed max_shape duplicate ([5d6d996](5d6d996)) * **asyncio:** replaced deepcopy with copy due to serialization problems ([dedc733](dedc733)) ### chore * update models_tokens.py with new model configurations ([d9752b1](d9752b1)) ### Docs * add diagram showing general structure/flow of the library ([13ae918](13ae918)) * **refactor:** added proxy-rotation usage and refactor readthedocs ([e256b75](e256b75)) * **refactor:** changed example ([c7ec114](c7ec114)) * **concurrent:** refactor theme and added benchmarck searchgraph ([ced2bbc](ced2bbc)) * update overview diagram with more models ([b441b30](b441b30)) ### CI * **release:** 0.10.0-beta.3 [skip ci] ([ad32298](ad32298)) * **release:** 0.10.0-beta.4 [skip ci] ([548bff9](548bff9)) * **release:** 0.10.0-beta.5 [skip ci] ([28c9dce](28c9dce)) * **release:** 0.10.0-beta.6 [skip ci] ([460d292](460d292)) * **release:** 0.11.0-beta.1 [skip ci] ([63c0dd9](63c0dd9)) * **release:** 0.11.0-beta.10 [skip ci] ([218b8ed](218b8ed)), closes [#232](#232) * **release:** 0.11.0-beta.11 [skip ci] ([8727d03](8727d03)) * **release:** 0.11.0-beta.2 [skip ci] ([7ae50c0](7ae50c0)) * **release:** 0.11.0-beta.3 [skip ci] ([106fb12](106fb12)), closes [#222](#222) * **release:** 0.11.0-beta.4 [skip ci] ([4ccddda](4ccddda)) * **release:** 0.11.0-beta.5 [skip ci] ([353382b](353382b)) * **release:** 0.11.0-beta.6 [skip ci] ([2724d3d](2724d3d)) * **release:** 0.11.0-beta.7 [skip ci] ([f0f7373](f0f7373)) * **release:** 0.11.0-beta.8 [skip ci] ([fa4edb4](fa4edb4)) * **release:** 0.11.0-beta.9 [skip ci] ([d2877d8](d2877d8))
## [0.11.1](v0.11.0...v0.11.1) (2024-05-14) ### Bug Fixes * **docs:** requirements-dev ([b0a67ba](b0a67ba))
chore(package manager)!: move from poetry to rye
## [1.0.1](v1.0.0...v1.0.1) (2024-05-15) ### Bug Fixes * **searchgraph:** used shallow copy to serialize obj ([096b665](096b665))
|
🎉 This PR is included in version 1.5.0-beta.4 🎉 The release is available on:
Your semantic-release bot 📦🚀 |
|
🎉 This PR is included in version 1.5.0 🎉 The release is available on:
Your semantic-release bot 📦🚀 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.