Merge pull request #357 from tenstorrent/ksrivastava/llama-3.3-70b-instruct

Upgrade to llama-3.3-70b-instruct

Author: Daggx

edenai_apis/apis/tenstorrent/outputs/llm/chat_output.json

@@ -1,14 +1,14 @@
 {
-  "id": "chat-3a48d0bd4e8d41cfa545da12d6ab83df",
+  "id": "chat-9014af30a40d4d409736f4b6d48e9351",
   "object": "chat.completion",
-  "created": 1742347236,
-  "model": "tenstorrent/Meta-Llama-3.1-70B-Instruct",
+  "created": 1745971102,
+  "model": "tenstorrent/Meta-Llama-3.3-70B-Instruct",
   "choices": [
     {
       "index": 0,
       "message": {
         "role": "assistant",
-        "content": "Here be a right purty boardwalk, if I do say so meself. Yer lookin' at a picture o' a lovely lake in Wisconsin, with a scenic boardwalk stretchin' out along the water's edge. The sun be shinin' bright, castin' a golden glow over the whole scene.\n\nThe boardwalk itself be made o' sturdy wood, with railin's to keep landlubbers like yerself from tumbilin' into the drink. There be plenty o' benches for sitin' and takin' in the views, and I can spy a few shops and eateries with outdoor tables for servin' up some tasty grub.\n\nThe lake be calm and peaceful, with a light breeze stirrin' up just enough ripples to give it some interest. satisfied ducks glide effortlessly across the water, leavin' trails o' ripples behind 'em. Behind the ducks be a backdrop o' trees and greenery, with a few sailboats bobbin' about in the distance.\n\nIt be a right pretty day, and I can almost smell the fish fry waftin' from the local eatery. Shiver me spyglass, I reckon it be a fine place to spend a lazy summer day, don't ye agree, matey?",
+        "content": "Yer lookin' fer a description o' a scenic boardwalk by a lake in Wisconsin, eh? Alright then, matey! Let me paint ye a picture o' this here scene.\n\nI be gazin' upon a tranquil lake, its waters as calm as a chest overflowin' with gold doubloons. The sun be shinin' bright, castin' a golden Robots glow upon the surroundings. To me left, I see a boardwalk stretchin' along the lake's edge, lined with wooden planks and railings as sturdy as me trusty cutlass.\n\nThe boardwalk be populated with landlubbers, strollin' and takin' in the sights o' the lake. Some be sittin' on benches, gazin' out at the water, while others be walkin' hand in hand, enjoyin' the romantic atmosphere. There be a few swashbucklers, too, with hyperlink their lines cast into the lake, hopin' to catch a big ol' fish fer dinner.\n\nTo me right, I see a forest o' tall trees, their leaves rustlin' in the gentle breeze like a treasure chest filled with golden coins. The trees be reflected in the lake's surface, creatin' a sense o' symmetry and balance, like a well-designed pirate ship.\n\nIn the distance, I see a few sailboats and kayaks, their sails and paddles glintin' in the sunlight as they glide across the lake. It be a peaceful scene, matey, like a calm sea on a sunny day. Ah, Wisconsin be a grand place, don't ye agree, matey?",
         "name": null,
         "function_call": null,
         "tool_calls": []
@@ -20,7 +20,7 @@
     "completion_tokens_details": {
       "audio_tokens": 0,
       "cached_tokens": 0,
-      "prompt_tokens": 264,
+      "prompt_tokens": 340,
       "completion_tokens": 0,
       "total_tokens": 0,
       "accepted_prediction_tokens": 0,
@@ -37,7 +37,7 @@
       "reasoning_tokens": 0,
       "rejected_prediction_tokens": 0
     },
-    "total_tokens": 330
+    "total_tokens": 406
   },
   "system_fingerprint": null
 }

edenai_apis/features/text/generation/generation_args.py

@@ -13,6 +13,6 @@ def generation_arguments(provider_name: str):
             "ai21labs": "j2-ultra",
             "meta": "llama3-1-70b-instruct-v1:0",
             "xai": "grok-2-latest",
-            "tenstorrent": "tenstorrent/Meta-Llama-3.1-70B-Instruct",
+            "tenstorrent": "tenstorrent/Meta-Llama-3.3-70B-Instruct",
         },
     }