fix: Added authentication to FireCrawl API, remove unused RobinAI references (#10737)

- Fixed Firecrawl webhook payloads to ensure proper data handling and
delivery.
- Removed unused Robin AI code to improve codebase cleanliness and
maintainability.
- Implement authentication for the Firecrawl endpoint to improve
security. A key is generated to secure the webhook URLs from FireCrawl.

---------

Co-authored-by: Pranav <pranavrajs@gmail.com>

spec/factories/inbox_response_source.rb

@@ -1,8 +0,0 @@
-# frozen_string_literal: true
-
-FactoryBot.define do
-  factory :inbox_response_source do
-    inbox
-    response_source
-  end
-end

spec/factories/response.rb

@@ -1,11 +0,0 @@
-# frozen_string_literal: true
-
-FactoryBot.define do
-  factory :response do
-    response_document
-    response_source
-    question { Faker::Lorem.sentence }
-    answer { Faker::Lorem.paragraph }
-    account
-  end
-end

spec/factories/response_document.rb

@@ -1,10 +0,0 @@
-# frozen_string_literal: true
-
-FactoryBot.define do
-  factory :response_document do
-    response_source
-    content { Faker::Lorem.paragraph }
-    document_link { Faker::Internet.url }
-    account
-  end
-end