Skip to content

Commit a91fcdf

Browse files
VinciGit00VinciGit00
authored
Merge pull request #505 from ScrapeGraphAI/temp-1
Pre/beta
2 parents 385084d + 886bab7 commit a91fcdf

File tree

179 files changed

+740
-1263
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

179 files changed

+740
-1263
lines changed

‎CHANGELOG.md

Lines changed: 90 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,10 +1,90 @@
1+
## [1.11.0-beta.10](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.0-beta.9...v1.11.0-beta.10) (2024-08-02)
2+
3+
4+
### Bug Fixes
5+
6+
* **AbstractGraph:** instantiation of Azure GPT models ([ade28fc](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/ade28fca2c3fdf40f28a80854e3b8435a52a6930)), closes [#498](https://github.com/ScrapeGraphAI/Scrapegraph-ai/issues/498)
7+
8+
## [1.11.0-beta.9](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.0-beta.8...v1.11.0-beta.9) (2024-08-02)
9+
10+
11+
### Features
12+
13+
* refactoring of the code ([9355507](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/9355507a2dc73342f325b6649e871df48ae13567))
14+
15+
## [1.11.0-beta.8](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.0-beta.7...v1.11.0-beta.8) (2024-08-01)
16+
17+
18+
### Features
19+
20+
* add integration in the abstract grapgh ([5ecdbe7](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/5ecdbe715f4bb223fa1be834fda07ccea2a51cb9))
21+
22+
23+
### Bug Fixes
24+
25+
* fixed bug on fetch_node ([968c69e](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/968c69e217d9c180b9b8c2aa52ca59b9a1733525))
26+
27+
## [1.11.0-beta.7](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.0-beta.6...v1.11.0-beta.7) (2024-08-01)
128
## [1.10.0-beta.7](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.10.0-beta.6...v1.10.0-beta.7) (2024-07-23)
229

330
## [1.11.3](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.2...v1.11.3) (2024-07-25)
431

532

33+
634
### Bug Fixes
735

36+
37+
* abstract_graph and removed unused embeddings ([0b4cfd6](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/0b4cfd6522dcad0eb418f0badd0f7824a1efd534))
38+
39+
40+
### Refactor
41+
42+
* move embeddings code from AbstractGraph to RAGNode ([a94ebcd](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/a94ebcde0078d66d33e67f7e0a87850efb92d408))
43+
* reuse code for common interface models ([bb73d91](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/bb73d916a1a7b378438038ec928eeda6d8f6ac9d))
44+
45+
## [1.11.0-beta.6](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.0-beta.5...v1.11.0-beta.6) (2024-07-31)
46+
47+
48+
### Features
49+
50+
* intregration of firebase ([4caed54](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/4caed545e5030460b2d5e46f9ad90546ce36f0ee))
51+
52+
## [1.11.0-beta.5](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.0-beta.4...v1.11.0-beta.5) (2024-07-30)
53+
54+
55+
### Features
56+
57+
* fix tests ([1db164e](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/1db164e9e682eefbc1414989a043fefa2e9009c2))
58+
59+
60+
### chore
61+
62+
* remove unused import ([88710f1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/88710f1a7c7d50f57108456112da30d1a12a1ba1))
63+
64+
65+
### Refactor
66+
67+
* **Ollama:** integrate new LangChain chat init ([d177afb](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/d177afb68be036465ede1f567d2562b145d77d36))
68+
* **OpenAI:** integrate new LangChain chat init ([5e3eb6e](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/5e3eb6e43df4bd4c452d34b49f254235e9ff1b22))
69+
* remove LangChain wrappers ([2c5f934](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/2c5f934f101e319ec4e61009d4c464ca4626c1ff))
70+
* remove LangChain wrappers for Ollama ([25066b2](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/25066b2bc51517e50058231664230b8edef365b9))
71+
* remove redundant LangChain wrappers ([9275486](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/927548624034b3c30eca60011d216720102d1815))
72+
* remove redundant wrappers for Ernie and Nvidia ([bc2c996](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/bc2c9967d2f13ade6eeb7b23e9b423f6e79aa890))
73+
74+
## [1.11.0-beta.4](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.0-beta.3...v1.11.0-beta.4) (2024-07-25)
75+
76+
77+
### Features
78+
79+
* add generate_answer node paralellization ([0c4b290](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/0c4b2908d98efbb2b0a6faf68618a801d726bb5f))
80+
81+
82+
### chore
83+
84+
* rebuild requirements ([2edad66](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/2edad66788cbd92f197e3b37db13c44bfa39e36a))
85+
86+
## [1.11.0-beta.3](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.0-beta.2...v1.11.0-beta.3) (2024-07-25)
87+
=======
888
* add llama 3.1 ([f872bdd](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/f872bdd24f9874660eea04f9ade570c96b6e7e93))
989

1090

@@ -18,6 +98,16 @@
1898

1999
### Bug Fixes
20100

101+
* add llama 3.1 ([f336c95](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/f336c95c2d1833d1f829d61ae7fa415ac2caf250))
102+
103+
## [1.11.0-beta.2](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.0-beta.1...v1.11.0-beta.2) (2024-07-24)
104+
105+
106+
### Features
107+
108+
* pdate models_tokens.py ([377d679](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/377d679eecd62611c0c9a3cba8202c6f0719ed31))
109+
110+
## [1.11.0-beta.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.10.4...v1.11.0-beta.1) (2024-07-23)
21111
* md conversion ([1d41f6e](https://github.com/ScrapeGraphAI/Scrapegraph-ai/commit/1d41f6eafe8ed0e191bb6a258d54c6388ff283c6))
22112

23113
## [1.11.1](https://github.com/ScrapeGraphAI/Scrapegraph-ai/compare/v1.11.0...v1.11.1) (2024-07-23)

‎examples/bedrock/csv_scraper_bedrock.py

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -33,9 +33,6 @@
3333
"client": "client_name",
3434
"model": "bedrock/anthropic.claude-3-sonnet-20240229-v1:0",
3535
"temperature": 0.0
36-
},
37-
"embeddings": {
38-
"model": "bedrock/cohere.embed-multilingual-v3"
3936
}
4037
}
4138
# ************************************************

‎examples/bedrock/csv_scraper_graph_multi_bedrock.py

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -28,9 +28,6 @@
2828
"client": "client_name",
2929
"model": "bedrock/anthropic.claude-3-sonnet-20240229-v1:0",
3030
"temperature": 0.0
31-
},
32-
"embeddings": {
33-
"model": "bedrock/cohere.embed-multilingual-v3"
3431
}
3532
}
3633

‎examples/bedrock/custom_graph_bedrock.py

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -28,9 +28,6 @@
2828
"client": "client_name",
2929
"model": "bedrock/anthropic.claude-3-sonnet-20240229-v1:0",
3030
"temperature": 0.0
31-
},
32-
"embeddings": {
33-
"model": "bedrock/cohere.embed-multilingual-v3"
3431
}
3532
}
3633

‎examples/bedrock/json_scraper_bedrock.py

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -32,9 +32,6 @@
3232
"client": "client_name",
3333
"model": "bedrock/anthropic.claude-3-sonnet-20240229-v1:0",
3434
"temperature": 0.0
35-
},
36-
"embeddings": {
37-
"model": "bedrock/cohere.embed-multilingual-v3"
3835
}
3936
}
4037

‎examples/bedrock/json_scraper_multi_bedrock.py

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -10,9 +10,6 @@
1010
"client": "client_name",
1111
"model": "bedrock/anthropic.claude-3-sonnet-20240229-v1:0",
1212
"temperature": 0.0
13-
},
14-
"embeddings": {
15-
"model": "bedrock/cohere.embed-multilingual-v3"
1613
}
1714
}
1815
FILE_NAME = "inputs/example.json"

‎examples/bedrock/pdf_scraper_graph_bedrock.py

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -18,9 +18,6 @@
1818
"client": "client_name",
1919
"model": "bedrock/anthropic.claude-3-sonnet-20240229-v1:0",
2020
"temperature": 0.0
21-
},
22-
"embeddings": {
23-
"model": "bedrock/cohere.embed-multilingual-v3"
2421
}
2522
}
2623

‎examples/bedrock/pdf_scraper_graph_multi_bedrock.py

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -11,9 +11,6 @@
1111
"client": "client_name",
1212
"model": "bedrock/anthropic.claude-3-sonnet-20240229-v1:0",
1313
"temperature": 0.0
14-
},
15-
"embeddings": {
16-
"model": "bedrock/cohere.embed-multilingual-v3"
1714
}
1815
}
1916
# ***************

‎examples/bedrock/scrape_plain_text_bedrock.py

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -33,9 +33,6 @@
3333
"client": "client_name",
3434
"model": "bedrock/anthropic.claude-3-sonnet-20240229-v1:0",
3535
"temperature": 0.0
36-
},
37-
"embeddings": {
38-
"model": "bedrock/cohere.embed-multilingual-v3"
3936
}
4037
}
4138

‎examples/bedrock/script_generator_bedrock.py

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -19,10 +19,7 @@
1919
"model": "bedrock/anthropic.claude-3-sonnet-20240229-v1:0",
2020
"temperature": 0.0
2121
},
22-
"embeddings": {
23-
"model": "bedrock/cohere.embed-multilingual-v3"
24-
},
25-
"library": "beautifulsoup"
22+
"library": "beautifulsoup"
2623
}
2724

2825
# ************************************************

‎examples/bedrock/script_multi_generator_bedrock.py

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -15,10 +15,7 @@
1515
"model": "bedrock/anthropic.claude-3-sonnet-20240229-v1:0",
1616
"temperature": 0.0
1717
},
18-
"embeddings": {
19-
"model": "bedrock/cohere.embed-multilingual-v3"
20-
},
21-
"library": "beautifulsoup"
18+
"library": "beautifulsoup"
2219
}
2320

2421
# ************************************************

‎examples/bedrock/search_graph_bedrock.py

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -16,9 +16,6 @@
1616
"client": "client_name",
1717
"model": "bedrock/anthropic.claude-3-sonnet-20240229-v1:0",
1818
"temperature": 0.0
19-
},
20-
"embeddings": {
21-
"model": "bedrock/cohere.embed-multilingual-v3"
2219
}
2320
}
2421
# ************************************************

‎examples/bedrock/search_graph_schema_bedrock.py

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -27,9 +27,6 @@ class Dishes(BaseModel):
2727
"client": "client_name",
2828
"model": "bedrock/anthropic.claude-3-sonnet-20240229-v1:0",
2929
"temperature": 0.0
30-
},
31-
"embeddings": {
32-
"model": "bedrock/cohere.embed-multilingual-v3"
3330
}
3431
}
3532

‎examples/bedrock/search_link_graph_bedrock.py

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -15,9 +15,6 @@
1515
"client": "client_name",
1616
"model": "bedrock/anthropic.claude-3-sonnet-20240229-v1:0",
1717
"temperature": 0.0
18-
},
19-
"embeddings": {
20-
"model": "bedrock/cohere.embed-multilingual-v3"
2118
}
2219
}
2320

‎examples/bedrock/smart_scraper_bedrock.py

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -19,9 +19,6 @@
1919
"client": "client_name",
2020
"model": "bedrock/anthropic.claude-3-sonnet-20240229-v1:0",
2121
"temperature": 0.0
22-
},
23-
"embeddings": {
24-
"model": "bedrock/cohere.embed-multilingual-v3"
2522
}
2623
}
2724

‎examples/bedrock/smart_scraper_multi_bedrock.py

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -17,9 +17,6 @@
1717
"client": "client_name",
1818
"model": "bedrock/anthropic.claude-3-sonnet-20240229-v1:0",
1919
"temperature": 0.0
20-
},
21-
"embeddings": {
22-
"model": "bedrock/cohere.embed-multilingual-v3"
2320
}
2421
}
2522

‎examples/bedrock/smart_scraper_schema_bedrock.py

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -26,9 +26,6 @@ class Projects(BaseModel):
2626
"client": "client_name",
2727
"model": "bedrock/anthropic.claude-3-sonnet-20240229-v1:0",
2828
"temperature": 0.0
29-
},
30-
"embeddings": {
31-
"model": "bedrock/cohere.embed-multilingual-v3"
3229
}
3330
}
3431

‎examples/bedrock/xml_scraper_bedrock.py

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -32,9 +32,6 @@
3232
"model": "bedrock/anthropic.claude-3-sonnet-20240229-v1:0",
3333
"temperature": 0.0
3434
},
35-
"embeddings": {
36-
"model": "bedrock/cohere.embed-multilingual-v3"
37-
}
3835
}
3936

4037
# ************************************************

‎examples/bedrock/xml_scraper_graph_multi_bedrock.py

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -29,9 +29,6 @@
2929
"model": "bedrock/anthropic.claude-3-sonnet-20240229-v1:0",
3030
"temperature": 0.0
3131
},
32-
"embeddings": {
33-
"model": "bedrock/cohere.embed-multilingual-v3"
34-
}
3532
}
3633

3734
# ************************************************

‎examples/deepseek/csv_scraper_deepseek.py

Lines changed: 0 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -30,11 +30,6 @@
3030
"model": "deepseek-chat",
3131
"openai_api_key": deepseek_key,
3232
"openai_api_base": 'https://api.deepseek.com/v1',
33-
},
34-
"embeddings": {
35-
"model": "ollama/nomic-embed-text",
36-
"temperature": 0,
37-
# "base_url": "http://localhost:11434", # set ollama URL arbitrarily
3833
},
3934
"verbose": True,
4035
}

‎examples/deepseek/csv_scraper_graph_multi_deepseek.py

Lines changed: 0 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -30,11 +30,6 @@
3030
"model": "deepseek-chat",
3131
"openai_api_key": deepseek_key,
3232
"openai_api_base": 'https://api.deepseek.com/v1',
33-
},
34-
"embeddings": {
35-
"model": "ollama/nomic-embed-text",
36-
"temperature": 0,
37-
# "base_url": "http://localhost:11434", # set ollama URL arbitrarily
3833
},
3934
"verbose": True,
4035
}

0 commit comments

Comments
 (0)