Sending a File
How to send a file to Mindee using a client library.
Requirements
Before proceeding you'll need to have one of the official Mindee client libraries installed.
Overview
This page will go into detail for each step, and list all possible options. It is reference documentation.
Overall, the steps to sending a file are:
Initialize the Mindee client.
Set inference parameters, in particular the model ID to use.
Load a source file.
Optional: adjust the source file before sending.
Send the file with the proper parameters.
Initialize the Mindee Client
This should be the first step in your code.
You should reuse the same client instance for all calls.
First import the needed classes:
from mindee import ClientV2, InferenceParameters
For the API key, you can pass it directly to the client. This is useful for quick testing.
api_key = "MY_API_KEY"
mindee_client = ClientV2(api_key)
Instead of passing the key directly, you can also set the following environment variable:
MINDEE_V2_API_KEY
This is recommended for production use.
In this way there is no need to pass the api_key
when initializing the client.
mindee_client = ClientV2()
Set Inference Parameters
Inference parameters control:
which model to use
server-side processing options
how the results will be returned to you
Processing Options
These are mostly the same options as present in the Web API.
Only the model_id
is required.
params = InferenceParameters(
# ID of the model, required.
model_id="MY_MODEL_ID",
# Options:
# If set to `True`, will enable Retrieval-Augmented Generation.
rag=True,
# Use an alias to link the file to your own DB.
# If empty, no alias will be used.
alias="MY_ALIAS"
)
Polling Configuration
The client library will POST the request for you, and then automatically poll the API.
When polling you really only need to set the model_id
.
params = InferenceParameters(model_id="MY_MODEL_ID")
You can also set the various polling parameters. However, we do not recommend setting this option unless you are encountering timeout problems.
from mindee import PollingOptions
params = InferenceParameters(
model_id="MY_MODEL_ID",
# Set only if having timeout issues.
polling_options=PollingOptions(
# Initial delay before the first polling attempt.
initial_delay_sec=3,
# Delay between each polling attempt.
delay_sec=1.5,
# Total number of polling attempts.
max_retries=80,
),
# ... any other options ...
)
Webhook Configuration
The client library will POST the request to your Web server, as configured by your webhook endpoint.
For more information on webhooks, take a look at the Webhooks page.
When using a webhook, you'll need to set the model_id
and which webhook(s) to use.
params = InferenceParameters(
model_id="MY_MODEL_ID",
webhook_ids=["ENDPOINT_1_UUID"],
# ... any other options ...
)
You can specify any number of webhook endpoint IDs, each will be sent the payload.
Load a Source File
You can load a source file from a path, from raw bytes, from a bytes stream, or from a language-specific object.
You'll need to use the mindee_client
instance created above.
To load a path string, use source_from_path
.
input_path = "/path/to/the/file.ext"
input_source = mindee_client.source_from_path(input_path)
To load a Path
instance, use source_from_path
.
from pathlib import Path
input_path = Path("/path/to/the/file.ext")
input_source = mindee_client.source_from_path(input_path)
To load raw bytes, use source_from_bytes
.
from pathlib import Path
input_path = Path("/path/to/the/file.ext")
with input_path.open("rb") as fh:
input_bytes = fh.read()
input_source = mindee_client.source_from_bytes(
input_bytes,
filename="file.ext",
)
To load a base-64 string, use source_from_b64string
.
The string will be decoded into bytes internally.
from pathlib import Path
input_path = Path("/path/to/the/base64_file.txt")
with input_path.open("r", encoding="utf-8") as fh:
input_base64 = fh.read()
input_source = mindee_client.source_from_b64string(
input_base64,
filename="base64_file.txt",
)
To load a file handle, use source_from_file
.
It must be opened in binary mode, as a BinaryIO
.
from pathlib import Path
input_path = Path("/path/to/the/file.ext")
with input_path.open("rb") as fh:
input_source = mindee_client.source_from_file(fh)
# IMPORTANT:
# Continue all operations inside the 'with' statement.
mindee_client.enqueue_and_get_inference(
input_source, params
)
Adjust the Source File
Optionally make changes and adjustments to the source file before sending.
Fixing PDF Headers
In some cases, PDFs will have corrupt or invalid headers. These files will return a 4xx HTTP error as the server will be unable to process them.
You can try to fix the headers using the provided functions.
Using the input_source
instance created above.
input_source.fix_pdf()
File Compression
There is no need to send excessively large files to the Mindee API.
Unfortunately, many modern smartphones can take very high resolution images.
We provide a way to compress images before sending to the API.
Using the input_source
instance created above.
Basic usage is very simple, and can be applied to both images and PDFs:
input_source.compress(quality=85)
For images, you can also set a maximum height and/or width. The aspect ratio will always be preserved.
input_source.compress(
max_width=1920, max_height=1920,
)
PDF Page Manipulations
In some cases, PDFs will have some superfluous pages present.
For example a cover page or terms and conditions which are not useful to the desired data extraction.
These extra pages count towards your billing and slow down processing.
It is therefore in your best interest to remove them before sending.
Parameters:
"page indexes" is required and is a list of 0-based page indexes.
"operation" specifies whether to keep only specified pages or remove specified pages.
"on min pages" is optional and specifies the minimum number of pages a document must have for the operation to take place. The value of
0
means any number of pages.
Using the input_source
instance created above.
from mindee import PageOptions
# Set the options as follows:
# For all documents, keep only the first page
page_options = PageOptions(
operation="KEEP_ONLY",
page_indexes=[0]
)
# Apply in-memory
input_source.apply_page_options(page_options)
Some other examples:
# Only for documents having 3 or more pages:
# Keep only these pages: first, penultimate, last
PageOptions(
operation="KEEP_ONLY",
on_min_pages=3,
page_indexes=[0, -2, -1]
)
# For all documents:
# Remove the first page
PageOptions(
operation="REMOVE",
page_indexes=[0]
)
# Only for documents having 10 or more pages:
# Remove the first 5 pages
PageOptions(
operation="REMOVE",
on_min_pages=10,
page_indexes=list(range(5))
)
Send the File
Now that all has been set, we can send the file to the Mindee servers for data extraction!
Using the mindee_client
, input_source
, and params
created in the steps above.
For polling, use:
response = mindee_client.enqueue_and_get_inference(
input_source, params
)
# To easily test which data was extracted,
# simply print an RST representation of the inference
print(response.inference)
For webhooks, use:
response = mindee_client.enqueue_inference(
input_source, params
)
# You can save the job ID for your records
print(response.job.id)
# If you set an `alias`, you can verify it was taken into account
print(response.job.alias)
Note: You can also use both methods!
First, make sure you've added a webhook ID to the InferenceParameters
instance.
Then, call enqueue_and_get_inference
.
You'll get the response via polling and webhooks will be used as well.
Process the Result
This page is long enough as it is, don't you think?
Head on over to the Processing a Result page for details on the next step.
Last updated
Was this helpful?