Skip to content

Reranker endpoint does not work #29

@duyanton

Description

@duyanton

Docker image: runpod/worker-infinity-embedding:1.1.4

Using same curl in README:

curl -X POST \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer <API_KEY>" \
  -d '{"input":{"model":"BAAI/bge-reranker-large","query":"Which product has warranty coverage?","docs":["Product A comes with a 2-year warranty","Product B is available in red and blue colors","All electronics include a standard 1-year warranty"],"return_docs":true}}' \
  https://api.runpod.ai/v2/<ENDPOINT_ID>/runsync

Error in pod:

{"requestId": "sync-6cf4391c-1fb9-4a38-9051-9a6c6e130c71-e1", "message": "Error while returning job result. | Object of type RerankReturnType is not JSON serializable", "level": "ERROR"}

The request also doesn't response to user. It hangs.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions