Hugging Face Expands Serverless Inference Options with New Provider Integrations - Related to bus, tomorrow,, expands, whole, inference

“Countries are coming online tomorrow, whole countries”

Shoutout to Stack Overflow user Hemant Singh, who helped the community understand pause vs stop in docker.

It’s been a long time since the idea of blogging has been lingering in my mind. This thought, however, was unable to materialize until now because I w......

Tree views are a core part of the GitHub experience. You’ve encountered one if you’ve ever navigated through a repository’s file structure or reviewed......

2024 was an exciting year at Stack Overflow. From the launch of new products and attributes that came directly from integrations with global partnership......

Hugging Face Expands Serverless Inference Options with New Provider Integrations

Hugging Face has launched the integration of four serverless inference providers Fal, Replicate, SambaNova, and Together AI, directly into its model pages. These providers are also integrated into Hugging Face's client SDKs for JavaScript and Python, allowing clients to run inference on various models with minimal setup.

This modification enables customers to select their preferred inference provider, either by using their own API keys for direct access or by routing requests through Hugging Face. The integration supports different models, including DeepSeek-R1, and provides a unified interface for managing inference across providers.

Developers can access these services through the website UI, SDKs, or direct HTTP calls. The integration allows seamless switching between providers by modifying the provider name in the API call while keeping the rest of the implementation unchanged. Hugging Face also offers a routing proxy for OpenAI-compatible APIs.

Rodrigo Liang, co-founder & CEO at SambaNova, stated:

We are excited to be partnering with Hugging Face to accelerate its Inference API. Hugging Face developers now have access to much faster inference speeds on a wide range of the best open source models.

And Zeke Sikelianos, founding designer at Replicate, quoted:

Hugging Face is the de facto home of open-source model weights, and has been a key player in making AI more accessible to the world. We use Hugging Face internally at Replicate as our weights registry of choice, and we're honored to be among the first inference providers to be featured in this launch.

Fast and accurate AI inference is essential for many applications, especially as demand for more tokens increases with test-time compute and Agentic AI. Open-source models help optimize performance on RDU, enabling developers to achieve up to 10x faster inference with improved accuracy.

Billing is handled by the inference provider if a user supplies their own API key. If requests are routed through Hugging Face, charges are applied at standard provider rates with no additional markup.

DeepSeek open-sourced DeepSeek-R1, an LLM fine-tuned with reinforcement learning (RL) to improve reasoning capability. DeepSeek-R1 achieves results on......

Neon is now available on the Azure marketplace. The new integration between Neon and Azure allows you to manage your Neon subscription and billing thr......

This is part two of a Makers series on the state of observability. Part one featured Christine Yen , CEO and co-founder of [website].

Amazon EventBridge Event Bus Cross-Account Event Delivery

AWS lately introduced a new feature for Amazon EventBridge that allows clients to deliver events directly to AWS services in different accounts. , this enhancement enables the use of multiple accounts to improve security and simplify business processes.

Amazon EventBridge Event Bus is a serverless event broker that enables scalable event-driven applications by routing events between applications, third-party SaaS, and AWS services. The newly introduced feature lets clients directly target services in another account without additional infrastructure. Chris McPeek, a principal solution architect at AWS, explains in an AWS Compute blog post:

With this new EventBridge feature, you can deliver events directly from the source event bus to the desired targets in different accounts. This simplifies the architecture and permission model and reduces latency in your event-driven solutions by having fewer components process events along the path from source to target.

For example, consumers can route events from their EventBridge Event Bus to a different team's SQS queue in another account, with the receiving team only needing to grant Identity Access Management (IAM) permissions for access. Events can be delivered across accounts to targets that support resource-based IAM policies, including Amazon SQS, AWS Lambda, Amazon Kinesis Data Streams, Amazon SNS, and Amazon API Gateway.

Targets in different accounts need a resource access policy to receive events from the source account's execution role. Targets like Amazon SQS queues, Amazon SNS topics, and AWS Lambda functions support this process.

Having an IAM role in the source account and a resource policy in the target account allows for fine-grained control over the PutEvents action. customers can also define service control policies (SCPs) to regulate who can send and receive events in their organization.

To set up cross-account event delivery (assuming the source event bus exists), clients can follow these three steps:

Target account: Create a delivery target ([website], SQS queue).

Target account: Apply a resource policy to the SQS queue to allow the source event bus execution role to send events.

Yan Cui, a Serverless Hero, tweeted on X:

This is AWESOME! EventBridge now delivers events to cross-account targets directly, without having to send them to the default bus in the target account first.

With Cross-Account Event Delivery, AWS brings another feature to the service after adding aspects like AppSync Integration. In a LinkedIn post, Sheen Brisals, an AWS Serverless Hero, stated:

In a way, this feature now pushes EventBridge to become a 'true' enterprise event-streaming platform. There are still gaps to fill, but we are getting there.

consumers can find more information and guidance on Amazon EventBridge on the documentation pages and GitHub repository. In addition, more details for the pricing of Event Bridge are available on the pricing page.

Over the last couple of years, the tech industry has accelerated efforts to consolidate tooling and increase automation, in an effort to lighten the c......

AI-driven data trends in Indian governance in 2025 are revolutionizing decision-making, enhancing efficiency, and improving public servi......

Key Takeaways GenAI can enhance employee productivity while safeguarding data security with data redaction and locally-hosted models.