Amazon Bedrock Chat and Embedding Models
Amazon Bedrock is a managed service that provides access to foundation models from AWS and other providers. The Quarkus LangChain4j extension integrates its chat, streaming chat, and embedding models.
Prerequisites
Before configuring the extension:
-
Enable access to the model you intend to use in Amazon Bedrock.
-
Choose an AWS Region where that model is available.
For the models and Regions supported by Bedrock, see the AWS model catalog.
Dependency
Add the following dependency to your project:
<dependency>
<groupId>io.quarkiverse.langchain4j</groupId>
<artifactId>quarkus-langchain4j-bedrock</artifactId>
<version>1.15.0.CR1</version>
</dependency>
Even better, if you use the Quarkus platform BOM (default for projects generated), add the Quarkus Langchain4J BOM and all dependency versions will align:
<dependencyManagement>
<dependencies>
<dependency>
<groupId>${quarkus.platform.group-id}</groupId>
<artifactId>${quarkus.platform.artifact-id}</artifactId>
<version>${quarkus.platform.version}</version>
<type>pom</type>
<scope>import</scope>
</dependency>
<dependency>
<groupId>${quarkus.platform.group-id}</groupId>
<artifactId>quarkus-langchain4j-bom</artifactId> (1)
<version>${quarkus.platform.version}</version> (2)
<type>pom</type>
<scope>import</scope>
</dependency>
</dependencies>
</dependencyManagement>
<dependencies>
<dependency>
<groupId>io.quarkiverse.langchain4j</groupId>
<artifactId>quarkus-langchain4j-bedrock</artifactId>
(3)
</dependency>
</dependencies>
| 1 | In your dependencyManagement section, add the quarkus-langchain4j-bom |
| 2 | Inherit the version from your platform version |
| 3 | Voilà, no need for version alignment anymore |
If no other chat model extension is selected, AI Services will automatically use the configured Bedrock chat model.
AWS Credentials
The extension uses the AWS SDK default credentials provider chain. For local development, configure an AWS profile or set the AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY environment variables.
When running on AWS, credentials can be supplied by the runtime, such as ECS task roles, EC2 instance profiles, or web identity tokens on EKS. Do not configure AWS credentials in application.properties.
For the complete list and order of credential sources, see the AWS SDK default credentials provider chain documentation.
Chat Model
Configure the Region and a Bedrock model ID in application.properties:
quarkus.langchain4j.bedrock.aws.region=us-east-1
quarkus.langchain4j.bedrock.chat-model.model-id=global.amazon.nova-2-lite-v1:0
# Optional generation parameters
quarkus.langchain4j.bedrock.chat-model.temperature=0.2
quarkus.langchain4j.bedrock.chat-model.max-tokens=1024
The extension registers both ChatModel and StreamingChatModel beans. You can inject them directly:
import dev.langchain4j.model.chat.ChatModel;
import dev.langchain4j.model.chat.StreamingChatModel;
import jakarta.enterprise.context.ApplicationScoped;
@ApplicationScoped
class AssistantService {
private final ChatModel chatModel;
private final StreamingChatModel streamingChatModel;
AssistantService(ChatModel chatModel, StreamingChatModel streamingChatModel) {
this.chatModel = chatModel;
this.streamingChatModel = streamingChatModel;
}
}
Or, declare an AI Service and let Quarkus inject the configured model:
import dev.langchain4j.service.UserMessage;
import io.quarkiverse.langchain4j.RegisterAiService;
import io.smallrye.mutiny.Multi;
@RegisterAiService
public interface Assistant {
String chat(String message);
@UserMessage("Answer the question: {message}")
Multi<String> stream(String message);
}
When an AI Service method returns Multi<String>, Quarkus uses the configured StreamingChatModel. Each item emitted by the Multi is part of the response. For REST and WebSocket examples, see the streamed responses guide.
AI Services are request-scoped by default. Apply a CDI scope when your chat memory lifecycle requires it.
Named Configurations
Use named configurations when an application needs more than one Bedrock model. Select a named model in an AI service or inject it with @ModelName.
quarkus.langchain4j.bedrock."fast".aws.region=us-east-1
quarkus.langchain4j.bedrock."fast".chat-model.model-id=global.amazon.nova-2-lite-v1:0
import dev.langchain4j.model.chat.ChatModel;
import dev.langchain4j.model.chat.StreamingChatModel;
import io.quarkiverse.langchain4j.ModelName;
import jakarta.enterprise.context.ApplicationScoped;
@ApplicationScoped
class AssistantService {
private final ChatModel chatModel;
private final StreamingChatModel streamingChatModel;
AssistantService(@ModelName("fast") ChatModel chatModel,
@ModelName("fast") StreamingChatModel streamingChatModel) {
this.chatModel = chatModel;
this.streamingChatModel = streamingChatModel;
}
}
Embedding Model
The extension also provides an EmbeddingModel. Configure it independently from the chat model:
quarkus.langchain4j.bedrock.aws.region=us-east-1
quarkus.langchain4j.bedrock.embedding-model.model-id=cohere.embed-english-v3
For Amazon Titan embedding models, use the embedding-model.titan configuration group. For Cohere embedding models, use embedding-model.cohere; the configuration reference lists the provider-specific options.
You can inject the configured EmbeddingModel directly:
import dev.langchain4j.model.embedding.EmbeddingModel;
import jakarta.enterprise.context.ApplicationScoped;
@ApplicationScoped
class EmbeddingService {
private final EmbeddingModel embeddingModel;
EmbeddingService(EmbeddingModel embeddingModel) {
this.embeddingModel = embeddingModel;
}
}
Bedrock Features
The chat model supports Bedrock guardrails, prompt caching, and reasoning when the selected model supports them. Verify model support and regional availability before enabling these capabilities.
Guardrails
Configure an existing Amazon Bedrock guardrail with its identifier and version:
quarkus.langchain4j.bedrock.chat-model.guardrail.guardrail-identifier=<guardrail-id>
quarkus.langchain4j.bedrock.chat-model.guardrail.guardrail-version=<guardrail-version>
# Optional for StreamingChatModel: sync or async
quarkus.langchain4j.bedrock.chat-model.guardrail.stream-processing-mode=sync
For more information about creating and configuring guardrails, see the Amazon Bedrock Guardrails documentation.
Prompt caching
Prompt caching reduces latency and input token costs when a prompt contains repeated content. The following example uses Claude Opus 4.7, which supports explicit prompt caching and a one-hour cache TTL:
quarkus.langchain4j.bedrock.chat-model.model-id=us.anthropic.claude-opus-4-7
quarkus.langchain4j.bedrock.chat-model.prompt-caching=AFTER_SYSTEM
quarkus.langchain4j.bedrock.chat-model.prompt-caching-ttl=1h
prompt-caching-ttl applies only when prompt-caching is configured. The available cache placement options are AFTER_SYSTEM, AFTER_USER_MESSAGE, and AFTER_TOOLS.
For supported models, regions, token requirements, and TTL options, see the Amazon Bedrock prompt caching documentation.
Reasoning
For models that support adaptive reasoning, configure the reasoning effort. The following example uses Claude Opus 4.7:
quarkus.langchain4j.bedrock.chat-model.model-id=us.anthropic.claude-opus-4-7
quarkus.langchain4j.bedrock.chat-model.reasoning-effort=medium
For models that use a token budget instead of adaptive reasoning, configure reasoning:
quarkus.langchain4j.bedrock.chat-model.reasoning=1024
Do not configure reasoning and reasoning-effort together. When both are set, reasoning-effort takes precedence.
For model-specific reasoning support, see the Amazon Bedrock reasoning documentation.
Configuration Reference
Configuration property fixed at build time - All other configuration properties are overridable at runtime
Configuration property |
Type |
Default |
|---|---|---|
Whether the model should be enabled Environment variable: |
boolean |
|
Whether the model should be enabled Environment variable: |
boolean |
|
Whether to enable the integration. Defaults to Environment variable: |
boolean |
|
Whether the Bedrock client should log requests Environment variable: |
boolean |
|
Whether the Bedrock client should log responses Environment variable: |
boolean |
|
Whether chat model body in request and response should be logged Environment variable: |
boolean |
|
Region used by the bedrock runtime api. See Regions Supported. Environment variable: |
string |
|
Override the endpoint used by the bedrock client Environment variable: |
string |
|
Specify a custom credentials provider to use for the bedrock client. Identified by bean name. Environment variable: |
string |
|
The maximum number retries the aws sdk client will attempt. Environment variable: |
int |
|
Configure the amount of time to allow the client to complete the execution of an API call. This timeout covers the entire client execution except for marshalling. This includes request handler execution, all HTTP requests including retries, unmarshalling, etc. This value should always be positive, if present. Environment variable: |
|
|
Connect Timeout for Bedrock calls Environment variable: |
|
|
Read Timeout for Bedrock calls Environment variable: |
|
|
The name of the proxy configuration to use, as registered in the Quarkus Proxy Registry. Precedence rules:
Environment variable: |
string |
|
If true, the REST clients will not provide additional contextual information (like REST client class and method names) when exception occurs during a client invocation. Environment variable: |
boolean |
|
The time in ms for which a connection remains unused in the connection pool before being evicted and closed. A timeout of Environment variable: |
int |
|
The size of the connection pool for this client. Environment variable: |
int |
|
If set to false disables the keep alive completely. Environment variable: |
boolean |
|
The class name of the host name verifier. The class must have a public no-argument constructor. Environment variable: |
string |
|
Set whether hostname verification is enabled. Default is enabled. This setting should not be disabled in production as it makes the client vulnerable to MITM attacks. Environment variable: |
boolean |
|
The trust store location. Can point to either a classpath resource or a file. Environment variable: |
string |
|
The trust store password. Environment variable: |
string |
|
The type of the trust store. Defaults to "JKS". Environment variable: |
string |
|
The key store location. Can point to either a classpath resource or a file. Environment variable: |
string |
|
The key store password. Environment variable: |
string |
|
The type of the key store. Defaults to "JKS". Environment variable: |
string |
|
The name of the TLS configuration to use. If not set and the default TLS configuration is configured ( Environment variable: |
string |
|
Whether chat model requests should be logged Environment variable: |
boolean |
|
Whether chat model responses should be logged Environment variable: |
boolean |
|
Whether chat model body in request and response should be logged Environment variable: |
boolean |
|
Region used by the bedrock runtime api. See Regions Supported. Environment variable: |
string |
|
Override the endpoint used by the bedrock client Environment variable: |
string |
|
Specify a custom credentials provider to use for the bedrock client. Identified by bean name. Environment variable: |
string |
|
The maximum number retries the aws sdk client will attempt. Environment variable: |
int |
|
Configure the amount of time to allow the client to complete the execution of an API call. This timeout covers the entire client execution except for marshalling. This includes request handler execution, all HTTP requests including retries, unmarshalling, etc. This value should always be positive, if present. Environment variable: |
|
|
Model id to use. See Models Supported Environment variable: |
string |
|
What sampling temperature to use, between 0.0 and 1.0. Higher values like 0.8 will make the output more random, while lower values like 0.2 will make it more focused and deterministic. It is generally recommended to set this or the Environment variable: |
double |
|
The maximum number of tokens to generate in the completion. The token count of your prompt plus Environment variable: |
int |
|
Double (0.0-1.0). Nucleus sampling, where the model considers the results of the tokens with top_p probability mass. So 0.1 means only the tokens comprising the top 10% probability mass are considered. It is generally recommended to set this or the Environment variable: |
double |
|
Reduces the probability of generating nonsense. A higher value (e.g. 100) will give more diverse answers, while a lower value (e.g. 10) will be more conservative Environment variable: |
int |
|
The custom text sequences that will cause the model to stop generating Environment variable: |
list of string |
|
Specifies the desired format for the model’s output. Allowable values: Environment variable: |
string |
|
Connect Timeout for Bedrock calls Environment variable: |
|
|
Read Timeout for Bedrock calls Environment variable: |
|
|
The name of the proxy configuration to use, as registered in the Quarkus Proxy Registry. Precedence rules:
Environment variable: |
string |
|
If true, the REST clients will not provide additional contextual information (like REST client class and method names) when exception occurs during a client invocation. Environment variable: |
boolean |
|
The time in ms for which a connection remains unused in the connection pool before being evicted and closed. A timeout of Environment variable: |
int |
|
The size of the connection pool for this client. Environment variable: |
int |
|
If set to false disables the keep alive completely. Environment variable: |
boolean |
|
The class name of the host name verifier. The class must have a public no-argument constructor. Environment variable: |
string |
|
Set whether hostname verification is enabled. Default is enabled. This setting should not be disabled in production as it makes the client vulnerable to MITM attacks. Environment variable: |
boolean |
|
The trust store location. Can point to either a classpath resource or a file. Environment variable: |
string |
|
The trust store password. Environment variable: |
string |
|
The type of the trust store. Defaults to "JKS". Environment variable: |
string |
|
The key store location. Can point to either a classpath resource or a file. Environment variable: |
string |
|
The key store password. Environment variable: |
string |
|
The type of the key store. Defaults to "JKS". Environment variable: |
string |
|
The name of the TLS configuration to use. If not set and the default TLS configuration is configured ( Environment variable: |
string |
|
The unique identifier of the guardrail that you want to use. Environment variable: |
string |
|
The version number for the guardrail. Environment variable: |
string |
|
The processing mode for streaming requests. Possible values are Environment variable: |
|
|
Enables prompt caching to reduce latency and costs for requests with repeated content. You can specify where to place the cache point in the prompt, possible values are Environment variable: |
|
|
How long the prompt cache entries live. Only applies when Allowable values: Environment variable: |
|
|
Enables reasoning capabilities of the model. It requires to set the maximum number of tokens to allocate for reasoning. This uses the legacy budget-based reasoning configuration ( Environment variable: |
int |
|
Enables adaptive reasoning with the given effort level ( Environment variable: |
|
|
Whether embedding model requests should be logged Environment variable: |
boolean |
|
Whether embedding model responses should be logged Environment variable: |
boolean |
|
Whether embedding model body in request and response should be logged Environment variable: |
boolean |
|
Region used by the bedrock runtime api. See Regions Supported. Environment variable: |
string |
|
Override the endpoint used by the bedrock client Environment variable: |
string |
|
Specify a custom credentials provider to use for the bedrock client. Identified by bean name. Environment variable: |
string |
|
The maximum number retries the aws sdk client will attempt. Environment variable: |
int |
|
Configure the amount of time to allow the client to complete the execution of an API call. This timeout covers the entire client execution except for marshalling. This includes request handler execution, all HTTP requests including retries, unmarshalling, etc. This value should always be positive, if present. Environment variable: |
|
|
Model name to use Environment variable: |
string |
|
The number of dimensions the output embedding should have Environment variable: |
int |
|
Flag indicating whether to normalize the output embedding Environment variable: |
boolean |
|
Prepends special tokens to differentiate each type from one another. You should not mix different types together, except when mixing types for search and retrieval. In this case, embed your corpus with the search_document type and embedded queries with type search_query type. Environment variable: |
string |
|
Specifies how the API handles inputs longer than the maximum token length Environment variable: |
string |
|
Connect Timeout for Bedrock calls Environment variable: |
|
|
Read Timeout for Bedrock calls Environment variable: |
|
|
The name of the proxy configuration to use, as registered in the Quarkus Proxy Registry. Precedence rules:
Environment variable: |
string |
|
If true, the REST clients will not provide additional contextual information (like REST client class and method names) when exception occurs during a client invocation. Environment variable: |
boolean |
|
The time in ms for which a connection remains unused in the connection pool before being evicted and closed. A timeout of Environment variable: |
int |
|
The size of the connection pool for this client. Environment variable: |
int |
|
If set to false disables the keep alive completely. Environment variable: |
boolean |
|
The class name of the host name verifier. The class must have a public no-argument constructor. Environment variable: |
string |
|
Set whether hostname verification is enabled. Default is enabled. This setting should not be disabled in production as it makes the client vulnerable to MITM attacks. Environment variable: |
boolean |
|
The trust store location. Can point to either a classpath resource or a file. Environment variable: |
string |
|
The trust store password. Environment variable: |
string |
|
The type of the trust store. Defaults to "JKS". Environment variable: |
string |
|
The key store location. Can point to either a classpath resource or a file. Environment variable: |
string |
|
The key store password. Environment variable: |
string |
|
The type of the key store. Defaults to "JKS". Environment variable: |
string |
|
The name of the TLS configuration to use. If not set and the default TLS configuration is configured ( Environment variable: |
string |
|
This property is deprecated: Use A string value in the form of Environment variable: |
string |
|
This property is deprecated: Use Proxy username, equivalent to the http.proxy or https.proxy JVM settings. Environment variable: |
string |
|
This property is deprecated: Use Proxy password, equivalent to the http.proxyPassword or https.proxyPassword JVM settings. Environment variable: |
string |
|
This property is deprecated: Use Hosts to access without proxy, similar to the http.nonProxyHosts or https.nonProxyHosts JVM settings. Please note that unlike the JVM settings, this property is empty by default. Environment variable: |
string |
|
This property is deprecated: Use A string value in the form of Environment variable: |
string |
|
This property is deprecated: Use Proxy username, equivalent to the http.proxy or https.proxy JVM settings. Environment variable: |
string |
|
This property is deprecated: Use Proxy password, equivalent to the http.proxyPassword or https.proxyPassword JVM settings. Environment variable: |
string |
|
This property is deprecated: Use Hosts to access without proxy, similar to the http.nonProxyHosts or https.nonProxyHosts JVM settings. Please note that unlike the JVM settings, this property is empty by default. Environment variable: |
string |
|
This property is deprecated: Use A string value in the form of Environment variable: |
string |
|
This property is deprecated: Use Proxy username, equivalent to the http.proxy or https.proxy JVM settings. Environment variable: |
string |
|
This property is deprecated: Use Proxy password, equivalent to the http.proxyPassword or https.proxyPassword JVM settings. Environment variable: |
string |
|
This property is deprecated: Use Hosts to access without proxy, similar to the http.nonProxyHosts or https.nonProxyHosts JVM settings. Please note that unlike the JVM settings, this property is empty by default. Environment variable: |
string |
|
Type |
Default |
|
Whether to enable the integration. Defaults to Environment variable: |
boolean |
|
Whether the Bedrock client should log requests Environment variable: |
boolean |
|
Whether the Bedrock client should log responses Environment variable: |
boolean |
|
Whether chat model body in request and response should be logged Environment variable: |
boolean |
|
Region used by the bedrock runtime api. See Regions Supported. Environment variable: |
string |
|
Override the endpoint used by the bedrock client Environment variable: |
string |
|
Specify a custom credentials provider to use for the bedrock client. Identified by bean name. Environment variable: |
string |
|
The maximum number retries the aws sdk client will attempt. Environment variable: |
int |
|
Configure the amount of time to allow the client to complete the execution of an API call. This timeout covers the entire client execution except for marshalling. This includes request handler execution, all HTTP requests including retries, unmarshalling, etc. This value should always be positive, if present. Environment variable: |
|
|
Connect Timeout for Bedrock calls Environment variable: |
|
|
Read Timeout for Bedrock calls Environment variable: |
|
|
The name of the proxy configuration to use, as registered in the Quarkus Proxy Registry. Precedence rules:
Environment variable: |
string |
|
If true, the REST clients will not provide additional contextual information (like REST client class and method names) when exception occurs during a client invocation. Environment variable: |
boolean |
|
The time in ms for which a connection remains unused in the connection pool before being evicted and closed. A timeout of Environment variable: |
int |
|
The size of the connection pool for this client. Environment variable: |
int |
|
If set to false disables the keep alive completely. Environment variable: |
boolean |
|
The class name of the host name verifier. The class must have a public no-argument constructor. Environment variable: |
string |
|
Set whether hostname verification is enabled. Default is enabled. This setting should not be disabled in production as it makes the client vulnerable to MITM attacks. Environment variable: |
boolean |
|
The trust store location. Can point to either a classpath resource or a file. Environment variable: |
string |
|
The trust store password. Environment variable: |
string |
|
The type of the trust store. Defaults to "JKS". Environment variable: |
string |
|
The key store location. Can point to either a classpath resource or a file. Environment variable: |
string |
|
The key store password. Environment variable: |
string |
|
The type of the key store. Defaults to "JKS". Environment variable: |
string |
|
The name of the TLS configuration to use. If not set and the default TLS configuration is configured ( Environment variable: |
string |
|
Whether chat model requests should be logged Environment variable: |
boolean |
|
Whether chat model responses should be logged Environment variable: |
boolean |
|
Whether chat model body in request and response should be logged Environment variable: |
boolean |
|
Region used by the bedrock runtime api. See Regions Supported. Environment variable: |
string |
|
Override the endpoint used by the bedrock client Environment variable: |
string |
|
Specify a custom credentials provider to use for the bedrock client. Identified by bean name. Environment variable: |
string |
|
The maximum number retries the aws sdk client will attempt. Environment variable: |
int |
|
Configure the amount of time to allow the client to complete the execution of an API call. This timeout covers the entire client execution except for marshalling. This includes request handler execution, all HTTP requests including retries, unmarshalling, etc. This value should always be positive, if present. Environment variable: |
|
|
Model id to use. See Models Supported Environment variable: |
string |
|
What sampling temperature to use, between 0.0 and 1.0. Higher values like 0.8 will make the output more random, while lower values like 0.2 will make it more focused and deterministic. It is generally recommended to set this or the Environment variable: |
double |
|
The maximum number of tokens to generate in the completion. The token count of your prompt plus Environment variable: |
int |
|
Double (0.0-1.0). Nucleus sampling, where the model considers the results of the tokens with top_p probability mass. So 0.1 means only the tokens comprising the top 10% probability mass are considered. It is generally recommended to set this or the Environment variable: |
double |
|
Reduces the probability of generating nonsense. A higher value (e.g. 100) will give more diverse answers, while a lower value (e.g. 10) will be more conservative Environment variable: |
int |
|
The custom text sequences that will cause the model to stop generating Environment variable: |
list of string |
|
Specifies the desired format for the model’s output. Allowable values: Environment variable: |
string |
|
Connect Timeout for Bedrock calls Environment variable: |
|
|
Read Timeout for Bedrock calls Environment variable: |
|
|
The name of the proxy configuration to use, as registered in the Quarkus Proxy Registry. Precedence rules:
Environment variable: |
string |
|
If true, the REST clients will not provide additional contextual information (like REST client class and method names) when exception occurs during a client invocation. Environment variable: |
boolean |
|
The time in ms for which a connection remains unused in the connection pool before being evicted and closed. A timeout of Environment variable: |
int |
|
The size of the connection pool for this client. Environment variable: |
int |
|
If set to false disables the keep alive completely. Environment variable: |
boolean |
|
The class name of the host name verifier. The class must have a public no-argument constructor. Environment variable: |
string |
|
Set whether hostname verification is enabled. Default is enabled. This setting should not be disabled in production as it makes the client vulnerable to MITM attacks. Environment variable: |
boolean |
|
The trust store location. Can point to either a classpath resource or a file. Environment variable: |
string |
|
The trust store password. Environment variable: |
string |
|
The type of the trust store. Defaults to "JKS". Environment variable: |
string |
|
The key store location. Can point to either a classpath resource or a file. Environment variable: |
string |
|
The key store password. Environment variable: |
string |
|
The type of the key store. Defaults to "JKS". Environment variable: |
string |
|
The name of the TLS configuration to use. If not set and the default TLS configuration is configured ( Environment variable: |
string |
|
The unique identifier of the guardrail that you want to use. Environment variable: |
string |
|
The version number for the guardrail. Environment variable: |
string |
|
The processing mode for streaming requests. Possible values are Environment variable: |
|
|
Enables prompt caching to reduce latency and costs for requests with repeated content. You can specify where to place the cache point in the prompt, possible values are Environment variable: |
|
|
How long the prompt cache entries live. Only applies when Allowable values: Environment variable: |
|
|
Enables reasoning capabilities of the model. It requires to set the maximum number of tokens to allocate for reasoning. This uses the legacy budget-based reasoning configuration ( Environment variable: |
int |
|
Enables adaptive reasoning with the given effort level ( Environment variable: |
|
|
Whether embedding model requests should be logged Environment variable: |
boolean |
|
Whether embedding model responses should be logged Environment variable: |
boolean |
|
Whether embedding model body in request and response should be logged Environment variable: |
boolean |
|
Region used by the bedrock runtime api. See Regions Supported. Environment variable: |
string |
|
Override the endpoint used by the bedrock client Environment variable: |
string |
|
Specify a custom credentials provider to use for the bedrock client. Identified by bean name. Environment variable: |
string |
|
The maximum number retries the aws sdk client will attempt. Environment variable: |
int |
|
Configure the amount of time to allow the client to complete the execution of an API call. This timeout covers the entire client execution except for marshalling. This includes request handler execution, all HTTP requests including retries, unmarshalling, etc. This value should always be positive, if present. Environment variable: |
|
|
Model name to use Environment variable: |
string |
|
The number of dimensions the output embedding should have Environment variable: |
int |
|
Flag indicating whether to normalize the output embedding Environment variable: |
boolean |
|
Prepends special tokens to differentiate each type from one another. You should not mix different types together, except when mixing types for search and retrieval. In this case, embed your corpus with the search_document type and embedded queries with type search_query type. Environment variable: |
string |
|
Specifies how the API handles inputs longer than the maximum token length Environment variable: |
string |
|
Connect Timeout for Bedrock calls Environment variable: |
|
|
Read Timeout for Bedrock calls Environment variable: |
|
|
The name of the proxy configuration to use, as registered in the Quarkus Proxy Registry. Precedence rules:
Environment variable: |
string |
|
If true, the REST clients will not provide additional contextual information (like REST client class and method names) when exception occurs during a client invocation. Environment variable: |
boolean |
|
The time in ms for which a connection remains unused in the connection pool before being evicted and closed. A timeout of Environment variable: |
int |
|
The size of the connection pool for this client. Environment variable: |
int |
|
If set to false disables the keep alive completely. Environment variable: |
boolean |
|
The class name of the host name verifier. The class must have a public no-argument constructor. Environment variable: |
string |
|
Set whether hostname verification is enabled. Default is enabled. This setting should not be disabled in production as it makes the client vulnerable to MITM attacks. Environment variable: |
boolean |
|
The trust store location. Can point to either a classpath resource or a file. Environment variable: |
string |
|
The trust store password. Environment variable: |
string |
|
The type of the trust store. Defaults to "JKS". Environment variable: |
string |
|
The key store location. Can point to either a classpath resource or a file. Environment variable: |
string |
|
The key store password. Environment variable: |
string |
|
The type of the key store. Defaults to "JKS". Environment variable: |
string |
|
The name of the TLS configuration to use. If not set and the default TLS configuration is configured ( Environment variable: |
string |
|
About the Duration format
To write duration values, use the standard You can also use a simplified format, starting with a number:
In other cases, the simplified format is translated to the
|