feat: update firecrawl tool with additional features #1445
Conversation
|
@manthanguptaa any updates on this ? |
|
Ran into this issue while running the code
|
cookbook/tools/firecrawl_tools.py
Outdated
| reasoning=True, | ||
| markdown=True, | ||
| ) | ||
| agent.print_response(f"Crawl and analyze the main use cases and insights using asynchronous crawling: {url}") |
There was a problem hiding this comment.
extra whitespace in the middle of the sentence
cookbook/tools/firecrawl_tools.py
Outdated
|
|
||
|
|
||
| if __name__ == "__main__": | ||
| url = "https://www.firecrawl.dev/blog" |
There was a problem hiding this comment.
replace the link with https://docs.phidata.com/agents
There was a problem hiding this comment.
Can you not have Agents in functions and then call them? I think you can have only 1 Agent with the following config
Agent(
tools=[FirecrawlTools(scrape=True, crawl=True, async_crawl=True, limit=25)],
show_tool_calls=True,
reasoning=True,
markdown=True,
)
and then ask the agent to do it synchronously or asynchronously
cookbook/tools/firecrawl_tools.py
Outdated
| ) | ||
| agent.print_response(f"Fetch all the blog links from the website: {url}") | ||
| agent.print_response( | ||
| "scrape and summarize the following website: https://www.firecrawl.dev/blog/using-structured-output-and-json-strict-mode-openai" |
There was a problem hiding this comment.
Replace this link with https://docs.phidata.com/workflows
| if async_crawl: | ||
| self.register(self.async_crawl_website) | ||
| if crawl or async_crawl: | ||
| self.register(self.check_crawl_status) |
There was a problem hiding this comment.
should this be here? What if only async_crawl is True
There was a problem hiding this comment.
if only async_crawl is True then also the code block will execute @manthanguptaa
@manthanguptaa did u encounter it while running the cookbook script ? PFA for ref: |
Async CrawlingandMapfunctionality. #1349cc: @manthanguptaa