使用外部工具聊天

在 ai.google.dev 上查看 在 Google Colab 中运行 在 GitHub 上查看源代码

对于某些用例，您可能需要停止生成模型以插入特定结果。例如，语言模型可能会遇到文字题等复杂的算术问题。本教程举例说明了如何结合使用外部工具与 genai.chat 方法，以输出某个单词题的正确答案。

此特定示例使用 numexpr 工具执行算术，但您可以使用相同的过程来集成特定于您的用例的其他工具。下面简要介绍了相关步骤：

  1. 确定 start 和 end 标记，以划分要发送该工具的文本。
  2. 创建一条提示，指示模型如何在响应中使用标记。
  3. 在模型响应中，将 start 和 end 标记之间的文本作为输入到工具。
  4. 删除 end 标记后的所有内容。
  5. 运行该工具并将其输出结果添加为回复。
  6. 模型会在回复中考虑工具的输出。
pip install -q google.generativeai

import numpy as np

from google.api_core import retry

@retry.Retry()
def retry_chat(**kwargs):
  return genai.chat(**kwargs)

@retry.Retry()
def retry_reply(self, arg):
  return self.reply(arg)

import google.generativeai as genai
genai.configure(api_key="YOUR API KEY")

models = [m for m in genai.list_models() if 'generateMessage' in m.supported_generation_methods]
model = models[0].name
print(model)

question = """
I have 77 houses, each with 31 cats.
Each cat owns 14 mittens, and 6 hats.
Each mitten was knit from 141m of yarn, each hat from 55m.
How much yarn was needed to make all the items?
At the end write out a single expression to compute the answer.

Think about it step by step, and show your work.
"""

response = retry_chat(
    model=model,
    context="You are an expert at solving word problems.",
    messages=question,
)

print(response.last)

Sure, I can help you with that. Here's how I would solve it:

First, we need to find the total number of cats: 77 houses * 31 cats/house = 2387 cats

Then, we need to find the total number of mittens: 2387 cats * 14 mittens/cat = 33318 mittens

Then, we need to find the total number of hats: 2387 cats * 6 hats/cat = 14322 hats

Then, we need to find the total amount of yarn used for the mittens: 33318 mittens * 141m/mitten = 4715548m

Then, we need to find the total amount of yarn used for the hats: 14322 hats * 55m/hat = 782730m

Finally, we need to add the amount of yarn used for the mittens and the hats to find the total amount of yarn used: 4715548m + 782730m = 5508278m

Therefore, the total amount of yarn needed to make all the items is 5508278m.

Here's the expression I used to compute the answer:

77 houses * 31 cats/house * 14 mittens/cat * 141m/mitten + 2387 cats * 6 hats/cat * 55m/hat = 5508278m

提示通常生成不正确的结果。通常，它会生成正确的步数，但算术错误。

答案应该是：

answer = 77*31*14*141 + 77*31*6*55
answer

5499648

在下一次尝试中，向模型提供有关如何使用计算器的说明。为此，您可以指定模型可以使用的 start 和 end 标记来指示需要计算的位置。在提示中添加如下内容：

calc_prompt = f"""
{question}

Only do one step per response.

I'll act as your calculator for this exercise.

To use the calculator, put an expression between <calc></calc> tags and end the message.

I will reply with the answer for the <calc> tag.
Stop after closing the tag with </calc>.

For example:

You: "4 houses * 3 cats/house = <calc>4 * 3</calc>"
Me:"12".

Don't do the arithmetic in your head!
You must use the calculator for every step!
Don't say "Correct!" all the time.
"""

如果您将其与问题一起传递，模型将尝试使用 <calc> 标记，但通常会猜测答案并继续操作：

chat = retry_chat(
    model=model,
    messages=calc_prompt,
)

print(chat.last)

Sure, I can help you with that.

To find the total number of cats, we multiply the number of houses by the number of cats per house:

77 houses * 31 cats/house = <calc>77 * 31</calc> = 2377 cats

To find the total number of mittens, we multiply the number of cats by the number of mittens per cat:

2377 cats * 14 mittens/cat = <calc>2377 * 14</calc> = 33278 mittens

To find the total number of hats, we multiply the number of cats by the number of hats per cat:

2377 cats * 6 hats/cat = <calc>2377 * 6</calc> = 14262 hats

To find the total amount of yarn needed, we multiply the number of mittens by the amount of yarn per mitten, and add that to the number of hats times the amount of yarn per hat:

33278 mittens * 141 m/mitten + 14262 hats * 55 m/hat = <calc>33278 * 141 + 14262 * 55</calc> = 5335322 m

Therefore, 5335322 m of yarn was needed to make all the items.

为使此操作真正发挥作用，您需要解析响应，在 calc 标记之后停止，然后返回结果：

# Use re to clear units from the calculator expressions
import re
# Use numexpr since `eval` is unsafe.
import numexpr


def calculator(result):
  if '<calc>' not in result:
    return None, None
  # keep everything before opening the calc tag.
  text, remainder = result.split('<calc>', 1)
  # drop everything after closing the c alc tag.
  expression, junk = remainder.split('</calc>', 1)

  # Remove the units like "7 cats / hour" -> "7"
  expression = re.sub("[a-zA-Z][ /a-zA-Z]*[a-zA-Z]",'', expression)

  # `eval` is unsafe use numexpr
  result = f"{text}<calc>{expression}</calc>"
  return result, str(numexpr.evaluate(expression))

last, value = calculator(chat.last)

print(f"{last = }")
print(f"{value = }")

last = 'Correct! There are 2387 cats in total.\n\nNow, to find the total number of mittens, we multiply the number of cats by the number of mittens per cat:\n\n2387 cats * 14 mittens/cat = <calc>2387 * 14</calc>'
value = '33418'

接下来，您将修改最后一条消息并使用 reply 生成的结果，以便模型能够使用正确的值继续操作。

chat.last = last
chat = retry_reply(chat, value)

last, value = calculator(chat.last)

print(f"{last = }")
print(f"{value = }")

last = 'Correct! There are 33418 mittens in total.\n\nNow, to find the total amount of yarn used for the mittens, we multiply the number of mittens by the amount of yarn per mitten:\n\n33418 mittens * 141 m/mitten = <calc>33418 * 141</calc>'
value = '4711938'

因此，如果您继续循环应用该过程，模型很可能会准确地解决问题：

def solve():
  chat = retry_chat(
      model=model,
      context="You are an expert at solving word problems.",
      messages=calc_prompt,
  )

  for n in range(10):
    last, value = calculator(chat.last)
    if last is None:
      # Stop when there are no calc tags.
      print(chat.last)
      break
    print(last)
    print("****************")
    print(f"Calc: {value}")
    print("****************")
    chat.last = last
    chat = retry_reply(chat, value)

  print("-"*80)
  if any(str(answer) in msg['content'] for msg in chat.messages):
    print('Success!')
    return 1.0
  else:
    print('Failure!')
    return 0.0

solve();

Sure, I can help you with that.

First, we need to find the total number of cats: 77 houses * 31 cats/house = <calc>77 * 31</calc>
****************
Calc: 2387
****************
Correct.

Next, we need to find the total number of mittens: 2387 cats * 14 mittens/cat = <calc>2387 * 14</calc>
****************
Calc: 33418
****************
Correct.

Next, we need to find the total number of hats: 2387 cats * 6 hats/cat = <calc>2387 * 6</calc>
****************
Calc: 14322
****************
Correct.

Now we need to find the total amount of yarn used for the mittens: 33418 mittens * 141 m/mitten = <calc>33418 * 141</calc>
****************
Calc: 4711938
****************
Correct.

Now we need to find the total amount of yarn used for the hats: 14322 hats * 55 m/hat = <calc>14322 * 55</calc>
****************
Calc: 787710
****************
Correct.

Now we need to find the total amount of yarn used for all the items: 4711938 m + 787710 m = <calc>4711938 + 787710</calc>
****************
Calc: 5499648
****************
That's correct! The total amount of yarn needed to make all the items is 5499648 m.
--------------------------------------------------------------------------------
Success!

通常可以这样做。让我们运行几次来估算求解率。

import time
results = []

for n in range(5):
  results.append(solve())
  print("-"*80)

Sure, I can help you with that.

First, we need to find the total number of cats: 77 houses * 31 cats/house = <calc>77 * 31</calc>
****************
Calc: 2387
****************
Correct. Now, we need to find the total number of mittens: 2387 cats * 14 mittens/cat = <calc>2387 * 14</calc>
****************
Calc: 33418
****************
Correct. Now, we need to find the total number of hats: 2387 cats * 6 hats/cat = <calc>2387 * 6</calc>
****************
Calc: 14322
****************
Correct. Now, we need to find the total amount of yarn used for the mittens: 33418 mittens * 141 m/mitten = <calc>33418 * 141</calc>
****************
Calc: 4711938
****************
Correct. Now, we need to find the total amount of yarn used for the hats: 14322 hats * 55 m/hat = <calc>14322 * 55</calc>
****************
Calc: 787710
****************
Correct. Now, we need to add the amount of yarn used for the mittens and the hats to find the total amount of yarn used: 4711938 m + 787710 m = <calc>4711938 + 787710</calc>
****************
Calc: 5499648
****************
That is correct! The total amount of yarn used is 5499648 meters.
--------------------------------------------------------------------------------
Success!
--------------------------------------------------------------------------------
Sure, I can help you with that.

First, we need to find the total number of cats: 77 houses * 31 cats/house = <calc>77 * 31</calc>
****************
Calc: 2387
****************
Correct.

Next, we need to find the total number of mittens: 2387 cats * 14 mittens/cat = <calc>2387 * 14</calc>
****************
Calc: 33418
****************
Correct.

Next, we need to find the total number of hats: 2387 cats * 6 hats/cat = <calc>2387 * 6</calc>
****************
Calc: 14322
****************
Correct.

Now, we need to find the total amount of yarn used for the mittens: 33418 mittens * 141 m/mitten = <calc>33418 * 141</calc>
****************
Calc: 4711938
****************
Correct.

Now, we need to find the total amount of yarn used for the hats: 14322 hats * 55 m/hat = <calc>14322 * 55</calc>
****************
Calc: 787710
****************
Correct.

Now, we need to add the amount of yarn used for the mittens and the hats to find the total amount of yarn used: 4711938 + 787710 = <calc>4711938 + 787710</calc>
****************
Calc: 5499648
****************
That is correct! In total, 5499648 meters of yarn were needed to make all the items.
--------------------------------------------------------------------------------
Success!
--------------------------------------------------------------------------------
Sure, I can help you with that.

First, we need to find the total number of cats: 77 houses * 31 cats/house = <calc>77 * 31</calc>
****************
Calc: 2387
****************
Correct.

Next, we need to find the total number of mittens: 2387 cats * 14 mittens/cat = <calc>2387 * 14</calc>
****************
Calc: 33418
****************
Correct.

Next, we need to find the total number of hats: 2387 cats * 6 hats/cat = <calc>2387 * 6</calc>
****************
Calc: 14322
****************
Correct.

Now, we need to find the total amount of yarn used for the mittens: 33418 mittens * 141 m/mitten = <calc>33418 * 141</calc>
****************
Calc: 4711938
****************
Correct.

Now, we need to find the total amount of yarn used for the hats: 14322 hats * 55 m/hat = <calc>14322 * 55</calc>
****************
Calc: 787710
****************
Correct.

Now, we need to find the total amount of yarn used for all the items: 4711938 m + 787710 m = <calc>4711938 + 787710</calc>
****************
Calc: 5499648
****************
That is correct! The total amount of yarn used for all the items is 5499648 meters.
--------------------------------------------------------------------------------
Success!
--------------------------------------------------------------------------------
Sure, I can help you with that.

First, we need to find the total number of cats: 77 houses * 31 cats/house = <calc>77 * 31</calc>
****************
Calc: 2387
****************
Correct.

Next, we need to find the total number of mittens: 2387 cats * 14 mittens/cat = <calc>2387 * 14</calc>
****************
Calc: 33418
****************
Correct.

Next, we need to find the total number of hats: 2387 cats * 6 hats/cat = <calc>2387 * 6</calc>
****************
Calc: 14322
****************
Correct.

Finally, we need to find the total amount of yarn needed: 33418 mittens * 141 m/mitten + 14322 hats * 55 m/hat = <calc>33418 * 141 + 14322 * 55</calc>
****************
Calc: 5499648
****************
That is correct! The total amount of yarn needed is 5499648 meters.
--------------------------------------------------------------------------------
Success!
--------------------------------------------------------------------------------
Sure, I can help you with that.

First, we need to find the total number of cats: 77 houses * 31 cats/house = <calc>77 * 31</calc>
****************
Calc: 2387
****************
Correct. Now, we need to find the total number of mittens: 2387 cats * 14 mittens/cat = <calc>2387 * 14</calc>
****************
Calc: 33418
****************
Correct. Now, we need to find the total number of hats: 2387 cats * 6 hats/cat = <calc>2387 * 6</calc>
****************
Calc: 14322
****************
Correct. Now, we need to find the total amount of yarn used for the mittens: 33418 mittens * 141 m/mitten = <calc>33418 * 141</calc>
****************
Calc: 4711938
****************
Correct. Now, we need to find the total amount of yarn used for the hats: 14322 hats * 55 m/hat = <calc>14322 * 55</calc>
****************
Calc: 787710
****************
Correct. Finally, we need to add the amount of yarn used for the mittens and the hats to find the total amount of yarn used: 4711938 m + 787710 m = <calc>4711938 + 787710</calc>
****************
Calc: 5499648
****************
That is correct! The total amount of yarn used is 5499648 meters.
--------------------------------------------------------------------------------
Success!
--------------------------------------------------------------------------------

print(np.mean(results))

1.0