bedrock-wrapper

Bedrock Wrapper is an npm package that simplifies the integration of existing OpenAI-compatible API objects with AWS Bedrock's serverless inference LLMs. Follow the steps below to integrate into your own application, or alternativly use the 🔀 Bedrock Proxy Endpoint project to spin up your own custom OpenAI server endpoint for even easier inference (using the standard baseUrl, and apiKey params).

An npm package that simplifies the integration of existing OpenAI-compatible API objects with AWS Bedrock’s serverless inference LLMs. It accepts an awsCreds object and an OpenAI chat-completions-style request object, then streams the Bedrock response back chunk by chunk. Messages use OpenAI’s role/content format, and the request’s model value maps to a supported Bedrock model name. For an even simpler setup, it can be paired with the companion Bedrock Proxy Endpoint project to stand up a full OpenAI-compatible server endpoint using the standard baseUrl and apiKey params.

Install

  • install package: npm install bedrock-wrapper