FR: Support for OpenAI-Compatible Endpoints in AI Assistant  SOLVED

Please post any ideas or requests for new features here for the End User Version of PDF-XChange (printer Drivers)

Moderators: PDF-XChange Support, Daniel - PDF-XChange, Chris - PDF-XChange, Sean - PDF-XChange, Vasyl - PDF-XChange, Ivan - Tracker Software, Stefan - PDF-XChange, Tracker - Clarion Support, John - Tracker Supp, Support Staff, moderators

nichu42
User
Posts: 6
Joined: Mon Jul 22, 2024 2:17 pm

FR: Support for OpenAI-Compatible Endpoints in AI Assistant

Post by nichu42 »

Dear PDF-XChange Editor Team,

I would like to request the addition of support for OpenAI-compatible endpoints in the AI Assistant feature. Currently, the Assistant only supports models from OpenAI, Anthropic, and Google, which limits users to a small set of proprietary, US-based providers.

Many users, especially in Europe, prioritize digital sovereignty, data privacy, and vendor neutrality.
Supporting OpenAI-compatible endpoints would allow us to use:
- Self-hosted or locally run LLMs
- European or region-specific LLM providers that adhere to GDPR and other local regulations
- Open-source models that align with organizational policies or ethical guidelines

Technical Note: OpenAI-compatible endpoints typically use the same API structure as OpenAI (e.g., `/v1/chat/completions`), so integration should be straightforward.

Thank you for considering this request. I believe it would significantly enhance the value of PDF-XChange Editor for a wide range of users, particularly those in regulated industries or with strict data governance requirements.
User avatar
Daniel - PDF-XChange
Site Admin
Posts: 12798
Joined: Wed Jan 03, 2018 6:52 pm

Re: FR: Support for OpenAI-Compatible Endpoints in AI Assistant

Post by Daniel - PDF-XChange »

Hello, nichu42

If i am not mistaken, so long as the API key follows the same structure as the base model, you should be able to utilize them in much the same way. I recall overhearing some testing of this with an "copilot" token, which operates through OpenAI as well. Please do try supplying your API key under the relevant section, and see if it works.

If you can cite specific models where this does not work, please do feel free to email [email protected] with the name(s) of the service/model. It will be passed along to the Dev team for review and hopefully implementation in the future.

Kind regards,
Dan McIntyre - Support Technician
PDF-XChange Co. LTD

+++++++++++++++++++++++++++++++++++
Our Web site domain and email address has changed as of 26/10/2023.
https://www.pdf-xchange.com
[email protected]
nichu42
User
Posts: 6
Joined: Mon Jul 22, 2024 2:17 pm

Re: FR: Support for OpenAI-Compatible Endpoints in AI Assistant

Post by nichu42 »

I would need to define a different endpoint. The one from OpenAI seems to be hardcoded.
User avatar
Sean - PDF-XChange
Site Admin
Posts: 996
Joined: Wed Sep 14, 2016 5:42 pm

Re: FR: Support for OpenAI-Compatible Endpoints in AI Assistant

Post by Sean - PDF-XChange »

HI Nichu,

Okay, thank you - if we can assist you with this issue, or if you need further input from our team on it, please email [email protected] and we will proceed with helping you by email.

Kind regards,
Sean Godley
Technical Writer
PDF-XChange Co LTD
Sales: +1 (250) 324-1621
Fax: +1 (250) 324-1623
nichu42
User
Posts: 6
Joined: Mon Jul 22, 2024 2:17 pm

Re: FR: Support for OpenAI-Compatible Endpoints in AI Assistant

Post by nichu42 »

I don't need support. It's a feature request. I thought it's the correct place for this?
User avatar
Sean - PDF-XChange
Site Admin
Posts: 996
Joined: Wed Sep 14, 2016 5:42 pm

Re: FR: Support for OpenAI-Compatible Endpoints in AI Assistant

Post by Sean - PDF-XChange »

Hi Nichu,

I was just reiterating Dan's point above about citing specific models where what you mentioned does not work. Other than that, I don't think there is any way we can proceed here, beyond what has already been discussed?

Kind regards,
Sean Godley
Technical Writer
PDF-XChange Co LTD
Sales: +1 (250) 324-1621
Fax: +1 (250) 324-1623
nichu42
User
Posts: 6
Joined: Mon Jul 22, 2024 2:17 pm

Re: FR: Support for OpenAI-Compatible Endpoints in AI Assistant

Post by nichu42 »

I'll try again to explain what this request is about.

You support three providers at the moment:
image.png
You can currently choose OpenAI. But it only asks for an API key. The request will go to https://api.openai.com/v1, which is hardcoded into PDF-XChange.

I request to add fourth option: OpenAI compatible.
So you can use any provider with an OpenAI-compatible API. Which is basically everyone, including famous OpenRouter that provides access to hundreds of models. You would need to enter the endpoint (e.g. https://openrouter.ai/api/v1) manually + API key.
You do not have the required permissions to view the files attached to this post.
User avatar
Sean - PDF-XChange
Site Admin
Posts: 996
Joined: Wed Sep 14, 2016 5:42 pm

Re: FR: Support for OpenAI-Compatible Endpoints in AI Assistant

Post by Sean - PDF-XChange »

Hi Nichu,

Okay, thanks for the clarification - I'll ask the development team for their input here.

Kind regards,
Sean Godley
Technical Writer
PDF-XChange Co LTD
Sales: +1 (250) 324-1621
Fax: +1 (250) 324-1623
User avatar
Alex - PDF-XChange
User
Posts: 39
Joined: Mon Nov 04, 2013 9:33 am

Re: FR: Support for OpenAI-Compatible Endpoints in AI Assistant  SOLVED

Post by Alex - PDF-XChange »

Hi Nichu,
Thank you for showing that there is interest in this feature. It is definitely on our to-do list.