Migration Guide: https://chwt.app/v4/migration This PR imports all the work related to Captain into the EE codebase. Captain represents the AI-based features in Chatwoot and includes the following key components: - Assistant: An assistant has a persona, the product it would be trained on. At the moment, the data at which it is trained is from websites. Future integrations on Notion documents, PDF etc. This PR enables connecting an assistant to an inbox. The assistant would run the conversation every time before transferring it to an agent. - Copilot for Agents: When an agent is supporting a customer, we will be able to offer additional help to lookup some data or fetch information from integrations etc via copilot. - Conversation FAQ generator: When a conversation is resolved, the Captain integration would identify questions which were not in the knowledge base. - CRM memory: Learns from the conversations and identifies important information about the contact. --------- Co-authored-by: Vishnu Narayanan <vishnu@chatwoot.com> Co-authored-by: Sojan <sojan@pepalo.com> Co-authored-by: iamsivin <iamsivin@gmail.com> Co-authored-by: Sivin Varghese <64252451+iamsivin@users.noreply.github.com>
133 lines
3.7 KiB
Ruby
133 lines
3.7 KiB
Ruby
require 'openai'
|
|
class Captain::Agent
|
|
attr_reader :name, :tools, :prompt, :persona, :goal, :secrets
|
|
|
|
def initialize(name:, config:)
|
|
@name = name
|
|
@prompt = construct_prompt(config)
|
|
@tools = prepare_tools(config[:tools] || [])
|
|
@messages = config[:messages] || []
|
|
@max_iterations = config[:max_iterations] || 10
|
|
@llm = Captain::LlmService.new(api_key: config[:secrets][:OPENAI_API_KEY])
|
|
@logger = Rails.logger
|
|
|
|
@logger.info(@prompt)
|
|
end
|
|
|
|
def execute(input, context)
|
|
setup_messages(input, context)
|
|
result = {}
|
|
@max_iterations.times do |iteration|
|
|
push_to_messages(role: 'system', content: 'Provide a final answer') if iteration == @max_iterations - 1
|
|
|
|
result = @llm.call(@messages, functions)
|
|
handle_llm_result(result)
|
|
|
|
break if result[:stop]
|
|
end
|
|
|
|
result[:output]
|
|
end
|
|
|
|
def register_tool(tool)
|
|
@tools << tool
|
|
end
|
|
|
|
private
|
|
|
|
def setup_messages(input, context)
|
|
if @messages.empty?
|
|
push_to_messages({ role: 'system', content: @prompt })
|
|
push_to_messages({ role: 'assistant', content: context }) if context.present?
|
|
end
|
|
push_to_messages({ role: 'user', content: input })
|
|
end
|
|
|
|
def handle_llm_result(result)
|
|
if result[:tool_call]
|
|
tool_result = execute_tool(result[:tool_call])
|
|
push_to_messages({ role: 'assistant', content: tool_result })
|
|
else
|
|
push_to_messages({ role: 'assistant', content: result[:output] })
|
|
end
|
|
result[:output]
|
|
end
|
|
|
|
def execute_tool(tool_call)
|
|
function_name = tool_call['function']['name']
|
|
arguments = JSON.parse(tool_call['function']['arguments'])
|
|
|
|
tool = @tools.find { |t| t.name == function_name }
|
|
tool.execute(arguments, {})
|
|
rescue StandardError => e
|
|
"Tool execution failed: #{e.message}"
|
|
end
|
|
|
|
def construct_prompt(config)
|
|
return config[:prompt] if config[:prompt]
|
|
|
|
"
|
|
Persona: #{config[:persona]}
|
|
Objective: #{config[:goal]}
|
|
|
|
Guidelines:
|
|
- Work diligently until the stated objective is achieved.
|
|
- Utilize only the provided tools for solving the task. Do not make up names of the functions
|
|
- Set 'stop: true' when the objective is complete.
|
|
- DO NOT provide tool_call as final answer
|
|
- If you have enough information to provide the details to the user, prepare a final result collecting all the information you have.
|
|
|
|
Output Structure:
|
|
|
|
If you find a function, that can be used, directly call the function.
|
|
|
|
When providing the final answer, use the JSON format:
|
|
{
|
|
'thought_process': 'Describe the reasoning and steps that led to the final result.',
|
|
'result': 'The complete answer in text form.',
|
|
'stop': true
|
|
}
|
|
"
|
|
end
|
|
|
|
def prepare_tools(tools = [])
|
|
tools.map do |_, tool|
|
|
Captain::Tool.new(
|
|
name: tool['name'],
|
|
config: {
|
|
description: tool['description'],
|
|
properties: tool['properties'],
|
|
secrets: tool['secrets'],
|
|
implementation: tool['implementation']
|
|
}
|
|
)
|
|
end
|
|
end
|
|
|
|
def functions
|
|
@tools.map do |tool|
|
|
properties = {}
|
|
tool.properties.each do |property_name, property_details|
|
|
properties[property_name] = {
|
|
type: property_details[:type],
|
|
description: property_details[:description]
|
|
}
|
|
end
|
|
required = tool.properties.select { |_, details| details[:required] == true }.keys
|
|
{
|
|
type: 'function',
|
|
function: {
|
|
name: tool.name,
|
|
description: tool.description,
|
|
parameters: { type: 'object', properties: properties, required: required }
|
|
}
|
|
}
|
|
end
|
|
end
|
|
|
|
def push_to_messages(message)
|
|
@logger.info("Message: #{message}")
|
|
@messages << message
|
|
end
|
|
end
|