Class: LlamaDeuce
Llama2 LLM implementation
Implements
Constructors
constructor
• new LlamaDeuce(init?
)
Parameters
Name | Type |
---|---|
init? | Partial <LlamaDeuce > |
Defined in
packages/core/src/llm/LLM.ts:434
Properties
chatStrategy
• chatStrategy: DeuceChatStrategy
Defined in
packages/core/src/llm/LLM.ts:427
hasStreaming
• hasStreaming: boolean
Implementation of
Defined in
packages/core/src/llm/LLM.ts:432
maxTokens
• Optional
maxTokens: number
Defined in
packages/core/src/llm/LLM.ts:430
model
• model: "Llama-2-70b-chat-old"
| "Llama-2-70b-chat-4bit"
| "Llama-2-13b-chat-old"
| "Llama-2-13b-chat-4bit"
| "Llama-2-7b-chat-old"
| "Llama-2-7b-chat-4bit"
Defined in
packages/core/src/llm/LLM.ts:426
replicateSession
• replicateSession: ReplicateSession
Defined in
packages/core/src/llm/LLM.ts:431