Skip to content

Self-hosted email verification script to clean up bad invalid email address lists. Supports various commercial email verification provider APIs all in one script

Notifications You must be signed in to change notification settings

cdekort/validate-emails

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 

Repository files navigation

Email Validation Script

Overview

The validate_emails.py is a Python-based tool for email verification and email validation that allows you to classify your email addresses' status using syntax, DNS, and SMTP (Simple Mail Transfer Protocol) and other checks and 3rd party APIs. Using the script's returned status classifications, you can then clean or scrub your email lists. This can be done self-hosted locally on a server or via the supported commercial email verification service APIs (jump straight to email verification provider API speed and result benchmarks). The validate_emails.py script is coded to conditionally support each commercial email verification providers' API rate limits and can be tuned via argument -wf work factor to adjust the number of concurrent threads used for single email address API requests. This ensures you do not waste time and credit $$$$ running into API rate limits.

The script's API Merge support also allows you to combine 2 API email verification providers results into one JSON formated output for double verification checks. The script provides a convenient way to verify the existence and deliverability of email addresses, helping you maintain a clean and accurate email list.

The script offers specific support for Xenforo forum member email list verification through dedicated Xenforo argument flags. These flags enable you to mark invalid Xenforo forum member emails and move them to a bounce_email status, effectively disabling Xenforo email sending to those members without actually deleting the Xenforo member account. You can then setup a Xenforo forum wide notice targetting bounce_email status users - prompting them to update their email addresses.

To reduce potential 3rd party email verification API costs, this script also supports Cloudflare HTTP Forward Proxy Cache With KV Storage for both per email check and bulk file API check results to be temporarily cached and return the email verification status codes at the Cloudflare CDN and Cloudflare Worker KV storage level.

Email verification results can also be optionally saved to Amazon AWS S3 and Cloudflare R2 object storage for long term storage and retrieval.

The validate_emails.py email validation script was written by George Liu (eva2000) for his paid consulting clients usage. The below is public documentation for the script.

Features

  • Validates email addresses using syntax, DNS and SMTP checks
  • Validates -f from email address's SPF, DKIM, DMARC records and logs them for troubleshooting mail deliverability
  • Optionally save your email verification results to S3 object storage providers - Cloudflare R2 or Amazon S3
  • Support local self-hosted email verification + API support for:
  • Supports Cloudflare HTTP Forward Proxy Cache With KV Storage for EmailListVerify per email check API
  • Classifies email addresses into various categories based on the syntax, DNS, and SMTP response
  • Supports concurrent processing for faster validation of multiple email addresses
  • Provides detailed logging for tracking the validation process
  • Allows customization of delay between requests to respect email server limitations
  • Supports input of email addresses via command-line arguments or a file
  • Identifies disposable email addresses and free domain name provider addresses
  • Checks email addresses against custom blacklists and whitelists
  • Supports different test modes for syntax, DNS, SMTP, and disposable email checks
  • Configurable SMTP port and TLS/SSL support
  • Supports SMTP profiles. However, using SMTP relay profiles won't get accurate SMTP checks. Locally ran server SMTP checks are more accurate.
  • Supports different DNS lookup methods: asyncio, concurrent, and sequential
  • Supports different processing modes: thread and asyncio
  • Xenforo support. Generates SQL queries for updating user status user_state in XenForo forum based email validation results. Allowing you to clean up your Xenforo user database's email addresses by disabling email sending to those specific bad email addresses.

Requirements

  • Python 3.6 minimum. Script tested on AlmaLinux 8 Python 3.6 and AlmaLinux 9 Python 3.9.

Usage

  1. Open a terminal or command prompt and navigate to the directory where the script is located.

  2. Run the script with the desired command-line arguments.

python validate_emails.py
usage: validate_emails.py [-h] -f FROM_EMAIL [-e EMAILS] [-l LIST_FILE] [-b BATCH_SIZE] [-d] [-v] [-delay DELAY] [--cache-timeout CACHE_TIMEOUT]
                          [-t TIMEOUT] [-r RETRIES] [-tm {syntax,dns,smtp,all,disposable}] [-dns {asyncio,concurrent,sequential}]
                          [-p {thread,asyncio}] [-bl BLACKLIST_FILE] [-wl WHITELIST_FILE] [-smtp {default,ses,generic,rotate}] [-xf]
                          [-xfdb XF_DATABASE] [-xfprefix XF_PREFIX] [-profile] [-wf WORKER_FACTOR]
                          [-api {emaillistverify,millionverifier,captainverify,proofy,myemailverifier,zerobounce,reoon,bouncify,bounceless}]
                          [-apikey EMAILLISTVERIFY_API_KEY] [-apikey_mv MILLIONVERIFIER_API_KEY]
                          [-apibulk {emaillistverify,millionverifier,proofy,bounceless}] [-apikey_cv CAPTAINVERIFY_API_KEY]
                          [-apikey_pf PROOFY_API_KEY] [-apiuser_pf PROOFY_USER_ID] [-pf_max_connections PROOFY_MAX_CONNECTIONS]
                          [-pf_batchsize PROOFY_BATCH_SIZE] [-apikey_mev MYEMAILVERIFIER_API_KEY] [-apikey_zb ZEROBOUNCE_API_KEY]
                          [-apikey_rn REOON_API_KEY] [-reoon_mode {quick,power}] [-reoon_max_connections REOON_MAX_CONNECTIONS]
                          [-apikey_bf BOUNCIFY_API_KEY] [-apikey_bl BOUNCELESS_API_KEY] [-mev_max_connections MEV_MAX_CONNECTIONS] [-apimerge]
                          [-apicache {emaillistverify,zerobounce,millionverifier}] [-apicachettl APICACHETTL]
                          [-apicachecheck {count,list,purge}] [-apicache-purge] [-store {r2,s3}] [-store-list]
validate_emails.py: error: the following arguments are required: -f/--from_email

The available arguments are:

  • -f, --from_email (required):
    • Description: The email address to use in the MAIL FROM command.
  • -e, --emails (optional):
    • Description: A single email or comma-separated list of emails to check.
  • -l, --list_file (optional):
    • Description: The path to a file containing emails, one per line.
  • -b, --batch_size (optional):
    • Description: The number of concurrent processes to use (default is 1).
  • -d, --debug (optional):
    • Description: Enable debug logging for more verbose output.
  • -v, --verbose (optional):
    • Description: Enable verbose output.
  • -delay, --delay (optional):
    • Description: The delay between requests in seconds (default is 1).
  • --cache-timeout (optional):
    • Description: Set the caching resolver timeout value (default is 14400).
  • -t, --timeout (optional):
    • Description: The timeout in seconds for SMTP connection and commands (default is 10).
  • -r, --retries (optional):
    • Description: The number of retries for temporary failures and timeouts (default is 3).
  • -tm, --test-mode (optional):
    • Description: The test mode to use for email validation. Available options are:
      • syntax: Check email format syntax only.
      • dns: Perform DNS validation only (default).
      • smtp: Perform SMTP validation only.
      • all: Perform all validations.
      • disposable: Check if the email is from a disposable domain.
  • -dns, --dns-method (optional):
    • Description: The DNS lookup method to use. Available options are:
      • asyncio: Use asynchronous DNS lookups using the asyncio library (default).
      • concurrent: Use concurrent DNS lookups using the concurrent.futures library.
      • sequential: Use basic sequential DNS lookups.
  • -p, --process_mode (optional):
    • Description: The processing mode to use for the process_emails function. Available options are:
      • thread: Use thread-based processing (default).
      • asyncio: Use asyncio-based processing.
  • -bl, --blacklist_file (optional):
    • Description: The path to a file containing blacklisted domains, one per line.
  • -wl, --whitelist_file (optional):
    • Description: The path to a file containing whitelisted domains, one per line.
  • -smtp, --smtp_profile (optional):
    • Description: The SMTP profile to use for email validation. Available options are:
      • default: Use the default SMTP settings (default).
      • ses: Use Amazon SES SMTP settings via ses.ini config file.
      • generic: Use generic SMTP settings via smtp.ini config file.
      • rotate: Use multiple SMTP profile settings via rotate.ini config file which you can rotate through.
  • -xf, --xf_sql (optional):
    • Description: Generate SQL queries for updating user_state in XenForo for emails with specific statuses.
  • -xfdb, --xf_database (optional):
    • Description: The XenForo database name (default is 'DATABNAME').
  • -xfprefix, --xf_prefix (optional):
    • Description: The XenForo table prefix (default is 'xf_').
  • -profile, --profile (optional):
    • Description: Enable profiling of the script.
  • -wf, --worker-factor (optional):
    • Description: The worker factor for calculating the maximum number of worker threads (default is 16).
  • -api, --api (optional):
    • Description: Specify the API to use for email verification. Available options are:
      • emaillistverify: Use the EmailListVerify API.
      • millionverifier: Use the MillionVerifier API.
      • myemailverifier: Use the MyEmailVerifier API.
      • captainverify: Use the CaptainVerify API.
      • proofy: Use the Proofy API.
      • zerobounce: Use the Zerobounce.net API.
      • reoon: Use the Zerobounce.net API.
      • bouncify: Use the Bouncify API.
      • bounceless: Use the Bounceless API.
  • -apimerge, --api_merge (optional):
    • Description: Merge and combine emaillistverify or millionverifier API results into one result
  • -apibulk, --api_bulk (optional):
    • Description: Use emaillistverify or millionverifier values for Bulk file API method.
  • -apikey, --emaillistverify_api_key (optional):
    • Description: The API key for the EmailListVerify service.
  • -apikey_mv, --millionverifier_api_key (optional):
    • Description: The API key for the MillionVerifier service.
  • -apikey_mev, --myemailverifier-api-key (optional):
    • Description: The API key for the MyEmailVerifier service.
  • -apikey_cv, --captainverify_api_key (optional):
    • Description: The API key for the CaptainVerify service.
  • -apikey_zb, --zerobounce_api_key (optional):
    • Description: The API key for the Zerobounce.net service.
  • -apikey_rn, --reoon_api_key (optional):
    • Description: The API key for the Reoon service.
  • -reoon_mode, --reoon_mode
    • Description: Reoon verification mode quick or power
  • -apikey_bf, --bouncify_api_key
    • Description: The API key for the Bouncify service.
  • -apikey_bl, --bounceless_api_key
    • Description: The API key for the Bounceless service.
  • -apikey_pf, --proofy_api_key (optional):
    • Description: The API key for the Proofy service.
  • -apiuser_pf, --proofy_user_id (optional):
    • Description: The Proofy userid.
  • -pf_max_connections (optional):
    • Description: Maximum number of concurrent connections for the Proofy.io API (default: 1)
  • -mev_max_connections (optional):
    • Description: Maximum number of concurrent connections for the MyEmailVerifier API (default: 1)
  • -reoon_max_connections (optional):
    • Description: Maximum number of concurrent connections for the Reoon API (default: 5)
  • -apicache, --api_cache (optional):
    • Description: Set the appropriate API's Cloudflare Worker KV cacheKey prefix. Available options are:
      • emaillistverify: Use with the EmailListVerify API.
      • zerobounce: Use with the ZeroBounce API.
      • millionverifier: Use with the MillionVerifier API.
  • -apicachettl (optional):
    • Description: this sets the cache TTL duration in seconds for how long Cloudflare CDN/KV stores in cache (default: 300 seconds)
  • -apicachecheck (optional):
    • Description: operates when -apicachettl is set and takes count or list or purge options to query the Cloudflare KV storage cache to count number of cached entries or list the entries themselves
  • -apicache-purge (optional):
    • Description: purges Cloudflare CDN/KV cache when -apicachecheck set to purge option

Validates -f from email address's SPF, DKIM, DMARC records when argument is passed and logs them

python validate_emails.py -f [email protected]
cat email_verification_log_2024-05-05_01-54-51.log

2024-05-05 01:54:51,105 - INFO - SPF record found for [email protected]
2024-05-05 01:54:51,105 - INFO - SPF record: "v=spf1 include:_spf.google.com +a +mx ~all"
2024-05-05 01:54:51,142 - ERROR - Error checking DKIM for [email protected] with selector default: The DNS response does not contain an answer to the question: default._domainkey.domain1.com. IN TXT
2024-05-05 01:54:51,174 - INFO - DKIM record found for [email protected] with selector google
2024-05-05 01:54:51,174 - INFO - DKIM record: "v=DKIM1; k=rsa; p=MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQCMF3nm2Za6EN0udFQLb35Jcy3u63iCzdaojAkVsCISJsHKe2ThgSsriU1MRm32abcd/u2aNEAxJ3jhN7TbkuV8j7xppV5PW+abcd/84lxa2xTlngXOymlJWleoTZUQQPkmkB66IO/XqZVj7RrF/Iru1qpAvJ9aW+6vCZEJFjCZowIDAQAB"
2024-05-05 01:54:51,237 - WARNING - Error checking DMARC for [email protected] with record name _dmarc: The DMARC record must be located at _dmarc._dmarc.domain1.com, not _dmarc.domain1.com
2024-05-05 01:54:51,562 - INFO - DMARC record found for [email protected] with record name _dmarc.mail
2024-05-05 01:54:51,562 - INFO - DMARC record: v=DMARC1; p=quarantine; sp=none; rua=mailto:[email protected],mailto:[email protected]; aspf=r; pct=100
2024-05-05 01:54:51,562 - INFO - DMARC policy check passed for [email protected]

Example usage for DNS only checks (skipping SMTP checks):

python validate_email.py -f [email protected] -e [email protected],[email protected] -tm dns

Example usage for DNS + SMTP checks:

python validate_email.py -f [email protected] -e [email protected],[email protected] -tm all

Notes:

  • If the -tm flag is not passed, it defaults to DNS test mode only.
  • Tuning -wf worker factor value for calculating the maximum number of worker threads can speed up the processing of emails when in -p thread process mode or when no -p flag is set. Example benchmark of 10,000 email addresses for -tm dns -p thread for DNS only tests (using default -dns asyncio) using process method = thread took 4mins 40s to complete with work factor -wf 4. However, with -wf 80 time to completion took ~40s on a Intel Core i7 4790K 4C/8T or ~33s on a Intel Xeon E-2276G 6C/12T based dedicated server.

Output

The script outputs the validation results in JSON format. Each email address is represented by an object with the following fields:

  • email: The email address.
  • status: The validation status of the email address. Possible values are:
    • valid_format: The email address has a valid format.
    • invalid: The email address has an invalid format.
    • valid_dns: The email address has valid DNS records.
    • invalid_dns: The email address has invalid DNS records.
    • ok: The email address passed SMTP validation.
    • unknown_email: The email address is unknown or doesn't exist.
    • temporary_failure: A temporary failure occurred during SMTP validation.
    • syntax_or_command_error: An SMTP syntax or command error occurred.
    • transaction_failed: The SMTP transaction failed.
    • timeout: A timeout occurred during SMTP validation.
    • skipped_smtp_check: SMTP validation was skipped based on the test mode.
  • status_code: SMTP validation check's logged SMTP response code.
  • free_email: Indicates whether the email address is from a free email provider. Possible values are yes, no, or unknown.
  • disposable_email: Indicates whether the email address is from a disposable domain. Possible values are yes, no, or notchecked.
  • xf_sql (optional): The SQL query for updating the user status in XenForo based on the validation result.

Logging

The script generates a log file named email_verification_log_<timestamp>.log in the same directory as the script. The log file contains detailed information about the validation process, including any errors or warnings encountered.

If -v verbose mode is used with -tm all for SMTP domain MX record checks, an additional debug log file named email_verification_log_debug_<timestamp>.log is generated in the same directory as the script. The debug log has extended logging of the SMTP responses.

Configuration

validate_emails.ini config file

Add validate_emails.ini config file support so Cloudflare Worker KV caching endpoint url can be defined outside of the script. If validate_emails.ini doesn't exist, you'll get this message

./validate_emails.py 
Error: 'api_url' setting not found in 'validate_emails.ini' file.
Please create the 'validate_emails.ini' file in the same directory as the script and add the 'api_url' setting.

validate_emails.ini contents setting api_url

[settings]
api_url=http=https://your_cf_worker.com

S3 Storage Support

Commercial email verification providers usually only store your file based uploaded or bulk file API uploaded files for a defined duration i.e. 15 to 30 days before they are deleted. And per email check API results are usually not stored at all. So if you need to store your per email check or bulk file API email verification results for longer, the validate_emails.py script now supports saving your results to S3 object storage providers - Cloudflare R2 or Amazon AWS S3. Saving such email verification result logs might be usual for historic comparisons and checks. According to ZeroBounce, on average an email list decays by an average of 25.74% yearly with the leading causes of bounced emails being invalid email addresses and catch-all email addresses.

Add optional Cloudflare R2 S3 object storage or Amazon AWS S3 object storage which will allow you to save your validate_emails.py ran JSON output in externel Cloudflare R2 or Amazon AWS S3 object storage buckets via validate_emails.ini defined:

For Cloudflare R2

[r2]
endpoint_url = https://your-account-id.r2.cloudflarestorage.com
aws_access_key_id = your-r2-access-key-id
aws_secret_access_key = your-r2-secret-access-key
bucket_name = your-r2-bucket-name

For Amazon AWS S3

[s3]
endpoint_url = https://your-s3-endpoint-url
aws_access_key_id = your-s3-access-key-id
aws_secret_access_key = your-s3-secret-access-key
bucket_name = your-s3-bucket-name

Below example to send validate_emails.py script results to Cloudflare R2 S3 object storage via -store r2 argument. Using EmailListVerify per email check API -api emaillistverify -apikey $elvkey + Cloudflare cached for 120 seconds -apicache emaillistverify -apicachettl 120

time python validate_emails.py -f [email protected] -e [email protected],[email protected],[email protected] -api emaillistverify -apikey $elvkey -apicache emaillistverify -apicachettl 120 -tm all -store r2

Output stored successfully in R2: emailapi-emaillistverify-cached/output_20240511051940.json
[
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    }
]

real    0m1.663s
user    0m0.391s
sys     0m0.039s

validate_emails.py script's Cloudflare R2 saved emailapi-emaillistverify-cached/output_20240511051940.json log contents

cat emailapi-emaillistverify-cached/output_20240511051940.json

[{"email": "[email protected]", "status": "unknown", "status_code": null, "free_email": "no", "disposable_email": "no"}, {"email": "[email protected]", "status": "unknown", "status_code": null, "free_email": "no", "disposable_email": "no"}, {"email": "[email protected]", "status": "unknown", "status_code": null, "free_email": "no", "disposable_email": "no"}]

validate_emails.py run log inspection

cat $(ls -Art | tail -3 | grep 'email_verification')                                             
2024-05-11 05:14:23,074 - INFO - Checking cache for email: [email protected]
2024-05-11 05:14:23,075 - INFO - Checking cache for email: [email protected]
2024-05-11 05:14:23,075 - INFO - Checking cache for email: [email protected]
2024-05-11 05:14:25,206 - INFO - Cache result: unknown
2024-05-11 05:14:25,966 - INFO - Cache result: unknown
2024-05-11 05:14:26,092 - INFO - Cache result: unknown

Non-cached EmailListVerify per email check API -api emaillistverify -apikey $elvkey run

time python validate_emails.py -f [email protected] -e [email protected],[email protected],[email protected] -api emaillistverify -apikey $elvkey -tm all -store r2

Output stored successfully in R2: emailapi-emaillistverify/output_20240511055822.json
[
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    }
]

real    0m10.612s
user    0m0.541s
sys     0m0.033s

validate_emails.py script's Cloudflare R2 saved emailapi-emaillistverify/output_20240511055822.json log contents

cat emailapi-emaillistverify/output_20240511055822.json

[{"email": "[email protected]", "status": "unknown", "status_code": null, "free_email": "no", "disposable_email": "no"}, {"email": "[email protected]", "status": "unknown", "status_code": null, "free_email": "no", "disposable_email": "no"}, {"email": "[email protected]", "status": "unknown", "status_code": null, "free_email": "no", "disposable_email": "no"}]

-smtp ses

The script supports loading SMTP settings from a configuration file named ses.ini. The file should have the following format:

[ses]
server = your_ses_smtp_server
port = your_ses_smtp_port
use_tls = True
username = your_ses_username
password = your_ses_password

If the ses SMTP profile is specified using the -smtp ses argument, the script will load the SMTP settings from the ses.ini file.

However, using SMTP relay profiles won't get accurate SMTP checks. Locally ran server SMTP checks are more accurate.

-smtp rotate

The rotate.ini file is used to store multiple SMTP profiles that can be rotated during the email verification process with -smtp rotate argument is passed on command line. Each profile represents a different SMTP server configuration.

Here's an example of how the rotate.ini file can be populated:

[profile1]
server = smtp1.example.com
port = 587
use_tls = yes
username = [email protected]
password = password1

[profile2]
server = smtp2.example.com
port = 465
use_tls = yes
username = [email protected]
password = password2

[profile3]
server = smtp3.example.com
port = 25
use_tls = no
username = [email protected]
password = password3

In this example, the rotate.ini file contains three SMTP profiles: profile1, profile2, and profile3. Each profile is defined as a separate section in the INI file.

The properties for each profile are:

  • server: The hostname or IP address of the SMTP server.
  • port: The port number to use for the SMTP connection (e.g., 25, 465, 587).
  • use_tls: Indicates whether to use TLS encryption for the SMTP connection. Set to yes or no.
  • username: The username for SMTP authentication.
  • password: The password for SMTP authentication.

You can add as many profiles as needed to the rotate.ini file, each with its own unique section name and SMTP server settings.

When the rotate profile is selected using the -smtp rotate option, the script will randomly choose one of the profiles defined in rotate.ini for each email verification request. This allows for distributing the email verification load across multiple SMTP servers.

Make sure to populate the rotate.ini file with the appropriate SMTP server settings for each profile before using the rotate profile option.

However, using SMTP relay profiles won't get accurate SMTP checks. Locally ran server SMTP checks are more accurate.

-smtp generic

The smtp.ini file is used to store the configuration for a single generic SMTP server that can be used for email verification with -smtp generic argument is passed on command line.

Here's an example of how the smtp.ini file can be populated:

[generic]
server = smtp.example.com
port = 587
use_tls = yes
username = [email protected]
password = password

In this example, the smtp.ini file contains a single section named [generic], which represents the generic SMTP profile.

The properties for the generic profile are:

  • server: The hostname or IP address of the SMTP server.
  • port: The port number to use for the SMTP connection (e.g., 25, 465, 587).
  • use_tls: Indicates whether to use TLS encryption for the SMTP connection. Set to yes or no.
  • username: The username for SMTP authentication.
  • password: The password for SMTP authentication.

When the generic profile is selected using the -smtp generic option, the script will use the SMTP server settings defined in the smtp.ini file for all email verification requests.

Make sure to populate the smtp.ini file with the appropriate SMTP server settings before using the generic profile option.

However, using SMTP relay profiles won't get accurate SMTP checks. Locally ran server SMTP checks are more accurate.

Customization

You can customize the behavior of the script by modifying the following variables in the code:

  • DEFAULT_DELAY: The default delay between requests in seconds (default is 1).
  • LARGE_PROVIDER_DELAY: The delay for large email providers in seconds (default is 2).
  • LARGE_PROVIDERS: A list of large email providers that require a longer delay between requests.

Troubleshooting

If you encounter any issues or errors while running the script, consider the following:

  • Ensure that you have installed all the required Python packages.
  • Check the log file for detailed error messages and traceback information.
  • Verify that the email addresses provided are valid and properly formatted.
  • Make sure you have a stable internet connection for accurate DNS and SMTP validations.
  • If you are using custom blacklist or whitelist files, ensure that they exist and contain valid domain entries.

domain_responses function

  1. The smtp_check function now accepts a domain_responses parameter, which is a dictionary to store the SMTP responses for each domain. It records the SMTP response code and message for each domain.

  2. The process_emails function creates a domain_responses dictionary to store the SMTP responses per domain. It passes this dictionary to the validate_and_classify function.

  3. After processing the emails, the process_emails function analyzes the SMTP responses for each domain. It calculates the failure rate based on the SMTP response codes. If the failure rate exceeds a predefined threshold (e.g., 5% in this example), it logs a warning message indicating that the verification strategy needs to be adjusted for that domain.

  4. The validate_and_classify function now accepts the domain_responses parameter and passes it to the smtp_check function.

With these changes, the script will proactively monitor SMTP responses and adjust the verification strategy based on the feedback from the servers.

Example in log

grep failure email_verification_log_2024-05-03_08-45-05.log

2024-05-03 08:45:07,910 - INFO - Acceptable failure rate (0.00%) for domain gmail.com.

Example Usage

AWS SES SMTP support and Xenforo support to display MySQL query for bad emails only to set their status to email_bounce passing flags -xf and -xfdb xenforo and -xfprefix xf_

python validate_emails.py -f [email protected] -l emaillist.txt -smtp ses -xf -xfdb xenforo -xfprefix xf_

ses.ini

[ses]
server = email-smtp.us-west-2.amazonaws.com
port = 587
use_tls = true
username = YOUR_AWS_SES_SMTP_USERNAME
password = YOUR_AWS_SES_SMTP_PASSWORD

Xenforo

Xenforo support to display MySQL query for bad emails only to set their status to email_bounce passing flags -xf and -xfdb xenforo and -xfprefix xf_ with disposable_email status field

Xenforo arguments mode for -xf -xfdb xenforo -xfprefix xf_ has ben updated to output

  • xf_sql for MySQL query you can run on SSH command line. The command's double quotes are escaped \" so you remove the backslash manually, or use below outlined jq tool to automatically remove it
  • xf_sql_batch for MySQL query run in MySQL client, phpmyadmin etc
  • xf_sql_user for MySQL query you can run on SSH command line to look up Xenforo user details for that email address. The command's double quotes are escaped \" so you remove the backslash manually, or use below outlined jq tool to automatically remove it
python validate_emails.py -f [email protected] -l emaillist.txt -tm all -xf -xfdb xenforo -xfprefix xf_
[
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "yes",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "yes",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "yes",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

Use jq tool to filter for xf_sql only

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql) | .xf_sql'
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo

Use jq tool to filter for xf_sql_batch only. You can pipe or place this output into a update.sql file and import into your Xenforo MySQL database to batch update the user's user_state

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql_batch) | .xf_sql_batch'
UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';
UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';
UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';
UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';
UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';
UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';
UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';
UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';

Use jq tool to filter for xf_sql_user only. This allows you to run on SSH command line the Xenforo database lookup for the Xenforo user details for the specific email address

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql_user) | .xf_sql_user'
mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\G" xenforo
mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\G" xenforo
mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\G" xenforo
mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\G" xenforo
mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\G" xenforo
mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\G" xenforo
mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\G" xenforo
mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\G" xenforo

Example running one of these commands for [email protected] on server where Xenforo is installed. The user_state would either be valid prior to running above UPDATE command or email_bounce after running UPDATE command.

mysql -e "SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\G" xenforo
*************************** 1. row ***************************
            user_id: 11
           username: pop
              email: [email protected]
      user_group_id: 2
secondary_group_ids: 3,4,6,8
      message_count: 191817
      register_date: 1400868747
      last_activity: 1715011284
         user_state: email_bounce
       is_moderator: 1
           is_admin: 1
          is_banned: 0

register_date date

date -d @1400868747
Fri May 23 18:12:27 UTC 2014

last_activity date

date -d @1715011284
Mon May  6 16:01:24 UTC 2024
python validate_emails.py -f [email protected] -l emaillist.txt -tm all -xf -xfdb xenforo -xfprefix xf_ | jq 'map({ status: .status }) | group_by(.status) | map({ status: .[0].status, count: length })'

[
  {
    "status": "invalid",
    "count": 1
  },
  {
    "status": "ok",
    "count": 8
  },
  {
    "status": "unknown_email",
    "count": 6
  }
]

Xenforo Email Bounce Log

Example lookup for Xenforo forum's email bounce log via my custom xf_bounce_log.py for email address [email protected] that is bouncing emails. And using validate_emails.py script's local and API to lookup email address status.

./xf_bounce_log.py -d $xfdb -n 10 -s desc | jq '.[] | select(.recipient == "[email protected]") | {bounce_id, message_type, action_taken, user_id, recipient, status_code, diagnostic_info, "Delivered-To": .raw_message["Delivered-To:"], "Delivery-date": .raw_message["Delivery-date:"], "Delivery-date": .raw_message["Delivery-date:"], "Subject": .raw_message["Subject:"]}'

{
  "bounce_id": 203,
  "message_type": "bounce",
  "action_taken": "soft",
  "user_id": 122136,
  "recipient": "[email protected]",
  "status_code": "4.4.7",
  "diagnostic_info": " 550 4.4.7 Message expired: unable to deliver in 840 minutes.<421 4.4.0 Unable to lookup DNS for canadlan-drugs.com>",
  "Delivered-To": "[email protected]",
  "Delivery-date": "Fri, 26 Apr 2024 15:44:06 +0000",
  "Subject": "Delivery Status Notification (Failure)"
}

validate_emails.py self-hosted local email verification check for syntax, DNS and SMTP checks for [email protected]

time python validate_emails.py -f [email protected] -e [email protected] -tm all         
[
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "no"
    }
]

real    0m0.932s
user    0m0.428s
sys     0m0.025s

validate_emails.py using external EmailListVerify API email verification check

time python validate_emails.py -f [email protected] -e [email protected] -tm all -api emaillistverify -apikey $elvkey
[
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    }
]

real    0m2.626s
user    0m0.461s
sys     0m0.023s

validate_emails.py using external MillionVerifier API email verification check

time python validate_emails.py -f [email protected] -e [email protected] -tm all -api millionverifier -apikey_mv $mvkey
[
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    }
]

real    0m1.142s
user    0m0.455s
sys     0m0.024s

validate_emails.py using external MyEmailVerifier API email verification check

time python validate_emails.py -f [email protected] -e [email protected] -tm all -api myemailverifier -apikey_mev $mevkey
[
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    }
]

real    0m1.823s
user    0m0.463s
sys     0m0.019s

validate_emails.py using external CaptainVerify API email verification check

time python validate_emails.py -f [email protected] -e [email protected] -tm all -api captainverify -apikey_cv $cvkey
[
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    }
]

real    0m25.264s
user    0m0.457s
sys     0m0.022s

Unfortunately, I ran out of credits to test with Proofy.io.

validate_emails.py using external Zerobounce API enabled run -api zerobounce -apikey_zb $zbkey -tm all with specified email address -e [email protected]. The status, sub_status and free_email_api JSON fields are from API and free_email and disposable_email JSON fields are from local script database checks.

python validate_emails.py -f [email protected] -e [email protected] -tm all -api zerobounce -apikey_zb $zbkey -tm all

[
    {
        "email": "[email protected]",
        "status": "invalid",
        "sub_status": "no_dns_entries",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no"
    }
]

validate_emails.py using external Reoon API enabled run -api reoon -apikey_rn $reokey -tm all with specified email address -e [email protected]. The status, role_account, mx_accepts_mail, spamtrap, mx_records, overall_score, safe_to_send, can_connect_smtp, inbox_full, catch_all, deliverable, disabled JSON field is from API and free_email and disposable_email JSON fields are from local script database checks.

Reoon has 2 modes for single email verification API which can be set via -reoon_mode to a value of either quick or power. The default mode without -reoon_mode being set is quick.

time python validate_emails.py -f [email protected] -e [email protected] -tm all -api reoon -apikey_rn $reokey

[
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "role_account": "no",
        "mx_accepts_mail": "no",
        "spamtrap": "no",
        "mx_records": null,
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    }
]

real    0m3.748s
user    0m0.358s
sys     0m0.028s

validate_emails.py using external Bouncify API enabled run -api bouncify -apikey_bf $bfkey -tm all with specified email address -e [email protected]. The status, free_email_api, disposable_email_api, role_api, and spamtrap_api JSON field are from API and free_email and disposable_email JSON fields are from local script database checks.

time python validate_emails.py -f [email protected] -e [email protected] -tm all -api bouncify -apikey_bf $bfkey
[
    {
        "email": "[email protected]",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    }
]

real    0m7.900s
user    0m0.357s
sys     0m0.030s

EmailListVerify

Here's a comparison using a commercial paid service EmailListVerify for the same emaillist.txt tested above. You can sign up using my affiliate link for EmailListVerify and free accounts get 100 free email verifications for starters.

disposable,"[email protected]"
dead_server,"[email protected]"
ok,"[email protected]"
disposable,"[email protected]"
ok,"[email protected]"
email_disabled,"[email protected]"
email_disabled,"[email protected]"
email_disabled,"[email protected]"
email_disabled,"[email protected]"
email_disabled,"[email protected]"
ok,"[email protected]"
email_disabled,"[email protected]"
ok,"[email protected]"
ok,"[email protected]"
ok,"[email protected]"

Where EmailListVerify status codes are as follows:

  • ok All is OK. The server is saying that it is ready to receive a letter to,this address, and no tricks have been detected
  • error The server is saying that delivery failed, but no information about,the email exists
  • smtp_error The SMTP answer from the server is invalid or the destination server,reported an internal error to us
  • smtp_protocol The destination server allowed us to connect but the SMTP,session was closed before the email was verified
  • unknown_email The server said that the delivery failed and that the email address does,not exist
  • attempt_rejected The delivery failed; the reason is similar to “rejected”
  • relay_error The delivery failed because a relaying problem took place
  • antispam_system Some anti-spam technology is blocking the,verification progress
  • email_disabled The email account is suspended, disabled, or limited and can not,receive emails
  • domain_error The email server for the whole domain is not installed or is,incorrect, so no emails are deliverable
  • ok_for_all The email server is saying that it is ready to accept letters,to any email address
  • dead_server The email server is dead, and no connection to it could be established
  • syntax_error There is a syntax error in the email address
  • unknown The email delivery failed, but no reason was given
  • accept_all The server is set to accept all emails at a specific domain.,These domains accept any email you send to them
  • disposable The email is a temporary address to receive letters and expires,after certain time period
  • spamtrap The email address is maintained by an ISP or a third party,which neither clicks nor opens emails
  • invalid_mx An undocumentated status value that isn't in their documentation. As the name implies, invalid MX DNS records

Filter for disposable_email = yes

python validate_emails.py -f [email protected] -l emaillist.txt -xf -xfdb xenforo -xfprefix xf_ -tm all | jq '.[] | select(.disposable_email == "yes")'
{
  "email": "[email protected]",
  "status": "ok",
  "status_code": 250,
  "free_email": "yes",
  "disposable_email": "yes"
}
{
  "email": "[email protected]",
  "status": "ok",
  "status_code": 250,
  "free_email": "no",
  "disposable_email": "yes"
}

Using jq tool to only list MySQL queries for bad emails only

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql) | .xf_sql'

mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo

Filter using jq tool for free_email = yes emails only

python validate_emails.py -f [email protected] -l emaillist.txt -tm all | jq '.[] | select(.free_email == "yes")'
{
  "email": "[email protected]",
  "status": "ok",
  "status_code": 250,
  "free_email": "yes",
  "disposable_email": "yes"
}
{
  "email": "[email protected]",
  "status": "ok",
  "status_code": 250,
  "free_email": "yes",
  "disposable_email": "no"
}
{
  "email": "[email protected]",
  "status": "unknown_email",
  "status_code": 550,
  "free_email": "yes",
  "disposable_email": "no"
}
{
  "email": "[email protected]",
  "status": "ok",
  "status_code": 250,
  "free_email": "yes",
  "disposable_email": "no"
}
{
  "email": "[email protected]",
  "status": "ok",
  "status_code": 250,
  "free_email": "yes",
  "disposable_email": "no"
}
{
  "email": "[email protected]",
  "status": "ok",
  "status_code": 250,
  "free_email": "yes",
  "disposable_email": "no"
}

-tm disposable mode only skipping SMTP server checks with email addresses in file emaillist.txt

python validate_emails.py -f [email protected] -l emaillist.txt -tm disposable -v

[
    {
        "email": "[email protected]",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "not_disposable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

-tm dns mode only skipping SMTP server checks with email addresses in file emaillist.txt

python validate_emails.py -f [email protected] -l emaillist.txt -tm dns -v
[
    {
        "email": "[email protected]",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_dns",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "notchecked"
    }
]

Logging SMTP server response displayed in -v verbose mode with email addresses in file emaillist.txt will create a 2nd debug log email_verification_log_debug_*.log with entries.

ls -lhArt | tail -2
-rw-r--r-- 1 root      root      9.8K May  4 23:35 email_verification_log_debug_2024-05-04_23-35-47.log
-rw-r--r-- 1 root      root      6.0K May  4 23:35 email_verification_log_2024-05-04_23-35-47.log
python validate_emails.py -f [email protected] -l emaillist.txt -tm all -v
[
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

Regular non-verbose log email_verification_log_2024-05-04_23-35-47.log will also show the smtp profile used to do the SMTP check testing as well as Acceptable failure rate metrics per domain.

cat email_verification_log_2024-05-04_23-35-47.log
2024-05-04 23:35:48,080 - INFO - Disposable email address: [email protected]
2024-05-04 23:35:48,082 - INFO - Disposable email address: [email protected]
2024-05-04 23:35:48,626 - INFO - SMTP response for [email protected] using profile [default]: 250, b'Accepted'
2024-05-04 23:35:49,022 - INFO - SMTP response for [email protected] using profile [default]: 250, b'2.1.5 Ok'
2024-05-04 23:35:49,082 - INFO - Validating [email protected]
2024-05-04 23:35:49,082 - INFO - Email DNS is valid: [email protected]
2024-05-04 23:35:49,082 - INFO - Validating [email protected]
2024-05-04 23:35:49,082 - INFO - Validating [email protected]
2024-05-04 23:35:49,082 - INFO - Validating [email protected]
2024-05-04 23:35:49,082 - INFO - Validating [email protected]
2024-05-04 23:35:49,082 - INFO - Email DNS is valid: [email protected]
2024-05-04 23:35:49,082 - INFO - Email DNS is valid: [email protected]
2024-05-04 23:35:49,082 - INFO - Email DNS is valid: [email protected]
2024-05-04 23:35:49,082 - INFO - Email DNS is valid: [email protected]
2024-05-04 23:35:49,082 - INFO - Validating [email protected]
2024-05-04 23:35:49,083 - INFO - Validating [email protected]
2024-05-04 23:35:49,083 - INFO - Email DNS is valid: [email protected]
2024-05-04 23:35:49,083 - INFO - Email DNS is valid: [email protected]
2024-05-04 23:35:49,084 - INFO - Validating [email protected]
2024-05-04 23:35:49,084 - INFO - Email DNS is valid: [email protected]
2024-05-04 23:35:49,646 - INFO - SMTP response for [email protected] using profile [default]: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1  https://support.google.com/mail/?p=NoSuchUser h14-20020a05640250ce00b00572b21fb7d5si3202708edb.683 - gsmtp"
2024-05-04 23:35:49,666 - INFO - SMTP response for [email protected] using profile [default]: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1  https://support.google.com/mail/?p=NoSuchUser sh43-20020a1709076eab00b00a597a01b74csi2965444ejc.273 - gsmtp"
2024-05-04 23:35:49,672 - INFO - SMTP response for [email protected] using profile [default]: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1  https://support.google.com/mail/?p=NoSuchUser gt34-20020a1709072da200b00a597ff2fc04si2617860ejc.981 - gsmtp"
2024-05-04 23:35:49,675 - INFO - SMTP response for [email protected] using profile [default]: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1  https://support.google.com/mail/?p=NoSuchUser p14-20020aa7d30e000000b00572d0cb1e66si1718373edq.661 - gsmtp"
2024-05-04 23:35:49,694 - INFO - SMTP response for [email protected] using profile [default]: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1  https://support.google.com/mail/?p=NoSuchUser wg10-20020a17090705ca00b00a5999e2028dsi2138359ejb.514 - gsmtp"
2024-05-04 23:35:49,752 - INFO - SMTP response for [email protected] using profile [default]: 250, b'2.1.5 OK j7-20020a5d5647000000b0034cfd826251si3647095wrw.519 - gsmtp'
2024-05-04 23:35:49,753 - INFO - SMTP response for [email protected] using profile [default]: 250, b'2.1.5 OK m8-20020a056402430800b005721e7edb0fsi3177955edc.665 - gsmtp'
2024-05-04 23:35:49,761 - INFO - SMTP response for [email protected] using profile [default]: 250, b'2.1.5 Recipient OK'
2024-05-04 23:35:50,085 - INFO - Validating [email protected]
2024-05-04 23:35:50,085 - INFO - Email DNS is valid: [email protected]
2024-05-04 23:35:50,085 - INFO - Validating [email protected]
2024-05-04 23:35:50,085 - INFO - Validating [email protected]
2024-05-04 23:35:50,086 - INFO - Email DNS is valid: [email protected]
2024-05-04 23:35:50,086 - INFO - Email DNS is valid: [email protected]
2024-05-04 23:35:50,086 - INFO - Validating [email protected]
2024-05-04 23:35:50,086 - INFO - Email DNS is valid: [email protected]
2024-05-04 23:35:50,545 - INFO - SMTP response for [email protected] using profile [default]: 250, b'2.1.5 Recipient OK'
2024-05-04 23:35:50,659 - INFO - SMTP response for [email protected] using profile [default]: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1  https://support.google.com/mail/?p=NoSuchUser w9-20020a5d4049000000b0034ddab36ff8si3678827wrp.499 - gsmtp"
2024-05-04 23:35:50,801 - INFO - SMTP response for [email protected] using profile [default]: 250, b'2.1.5 OK d7-20020a05600c34c700b0041d7d5787bfsi3791910wmq.193 - gsmtp'
2024-05-04 23:35:50,802 - INFO - SMTP response for [email protected] using profile [default]: 250, b'recipient <[email protected]> ok'
2024-05-04 23:35:50,802 - INFO - Acceptable failure rate (0.00%) for domain mailsac.com.
2024-05-04 23:35:50,802 - INFO - Acceptable failure rate (0.00%) for domain tempr.email.
2024-05-04 23:35:50,802 - INFO - Acceptable failure rate (0.00%) for domain domain1.com.
2024-05-04 23:35:50,802 - INFO - Acceptable failure rate (0.00%) for domain domain2.com.
2024-05-04 23:35:50,802 - INFO - Acceptable failure rate (0.00%) for domain hotmail.com.
2024-05-04 23:35:50,803 - INFO - Acceptable failure rate (0.00%) for domain outlook.com.
2024-05-04 23:35:50,803 - INFO - Acceptable failure rate (0.00%) for domain gmail.com.
2024-05-04 23:35:50,803 - INFO - Acceptable failure rate (0.00%) for domain yahoo.com.

Verbose debug log email_verification_log_debug_2024-05-04_23-35-47.log

cat email_verification_log_debug_2024-05-04_23-35-47.log
2024-05-04 23:35:48,080 - DEBUG - Connecting to SMTP server alt.mailsac.com. on port 25
2024-05-04 23:35:48,083 - DEBUG - Connecting to SMTP server mx.discard.email. on port 25
2024-05-04 23:35:48,328 - DEBUG - SMTP connection established
2024-05-04 23:35:48,403 - DEBUG - EHLO command sent
2024-05-04 23:35:48,403 - DEBUG - Sending MAIL FROM command: [email protected]
2024-05-04 23:35:48,477 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:48,477 - DEBUG - Sending RCPT TO command for: [email protected]
2024-05-04 23:35:48,552 - DEBUG - RCPT TO response: 250, b'Accepted'
2024-05-04 23:35:48,626 - DEBUG - SMTP session closed
2024-05-04 23:35:48,642 - DEBUG - SMTP connection established
2024-05-04 23:35:48,737 - DEBUG - EHLO command sent
2024-05-04 23:35:48,737 - DEBUG - Sending MAIL FROM command: [email protected]
2024-05-04 23:35:48,832 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:48,832 - DEBUG - Sending RCPT TO command for: [email protected]
2024-05-04 23:35:48,927 - DEBUG - RCPT TO response: 250, b'2.1.5 Ok'
2024-05-04 23:35:49,022 - DEBUG - SMTP session closed
2024-05-04 23:35:49,082 - DEBUG - Connecting to SMTP server aspmx5.googlemail.com. on port 25
2024-05-04 23:35:49,083 - DEBUG - Connecting to SMTP server aspmx5.googlemail.com. on port 25
2024-05-04 23:35:49,083 - DEBUG - Connecting to SMTP server aspmx5.googlemail.com. on port 25
2024-05-04 23:35:49,083 - DEBUG - Connecting to SMTP server aspmx5.googlemail.com. on port 25
2024-05-04 23:35:49,083 - DEBUG - Connecting to SMTP server aspmx5.googlemail.com. on port 25
2024-05-04 23:35:49,084 - DEBUG - Connecting to SMTP server aspmx5.googlemail.com. on port 25
2024-05-04 23:35:49,084 - DEBUG - Connecting to SMTP server aspmx2.googlemail.com. on port 25
2024-05-04 23:35:49,084 - DEBUG - Connecting to SMTP server hotmail-com.olc.protection.outlook.com. on port 25
2024-05-04 23:35:49,277 - DEBUG - SMTP connection established
2024-05-04 23:35:49,277 - DEBUG - SMTP connection established
2024-05-04 23:35:49,285 - DEBUG - SMTP connection established
2024-05-04 23:35:49,291 - DEBUG - SMTP connection established
2024-05-04 23:35:49,294 - DEBUG - SMTP connection established
2024-05-04 23:35:49,305 - DEBUG - SMTP connection established
2024-05-04 23:35:49,307 - DEBUG - SMTP connection established
2024-05-04 23:35:49,367 - DEBUG - EHLO command sent
2024-05-04 23:35:49,367 - DEBUG - Sending MAIL FROM command: [email protected]
2024-05-04 23:35:49,367 - DEBUG - EHLO command sent
2024-05-04 23:35:49,367 - DEBUG - Sending MAIL FROM command: [email protected]
2024-05-04 23:35:49,382 - DEBUG - EHLO command sent
2024-05-04 23:35:49,382 - DEBUG - Sending MAIL FROM command: [email protected]
2024-05-04 23:35:49,383 - DEBUG - EHLO command sent
2024-05-04 23:35:49,384 - DEBUG - Sending MAIL FROM command: [email protected]
2024-05-04 23:35:49,397 - DEBUG - EHLO command sent
2024-05-04 23:35:49,397 - DEBUG - Sending MAIL FROM command: [email protected]
2024-05-04 23:35:49,399 - DEBUG - EHLO command sent
2024-05-04 23:35:49,399 - DEBUG - Sending MAIL FROM command: [email protected]
2024-05-04 23:35:49,401 - DEBUG - EHLO command sent
2024-05-04 23:35:49,401 - DEBUG - Sending MAIL FROM command: [email protected]
2024-05-04 23:35:49,455 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:49,455 - DEBUG - Sending RCPT TO command for: [email protected]
2024-05-04 23:35:49,455 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:49,455 - DEBUG - Sending RCPT TO command for: [email protected]
2024-05-04 23:35:49,473 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:49,473 - DEBUG - Sending RCPT TO command for: [email protected]
2024-05-04 23:35:49,474 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:49,474 - DEBUG - Sending RCPT TO command for: [email protected]
2024-05-04 23:35:49,485 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:49,485 - DEBUG - Sending RCPT TO command for: [email protected]
2024-05-04 23:35:49,494 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:49,494 - DEBUG - Sending RCPT TO command for: [email protected]
2024-05-04 23:35:49,500 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:49,500 - DEBUG - Sending RCPT TO command for: [email protected]
2024-05-04 23:35:49,530 - DEBUG - SMTP connection established
2024-05-04 23:35:49,558 - DEBUG - RCPT TO response: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1  https://support.google.com/mail/?p=NoSuchUser h14-20020a05640250ce00b00572b21fb7d5si3202708edb.683 - gsmtp"
2024-05-04 23:35:49,576 - DEBUG - RCPT TO response: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1  https://support.google.com/mail/?p=NoSuchUser sh43-20020a1709076eab00b00a597a01b74csi2965444ejc.273 - gsmtp"
2024-05-04 23:35:49,580 - DEBUG - RCPT TO response: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1  https://support.google.com/mail/?p=NoSuchUser gt34-20020a1709072da200b00a597ff2fc04si2617860ejc.981 - gsmtp"
2024-05-04 23:35:49,586 - DEBUG - EHLO command sent
2024-05-04 23:35:49,586 - DEBUG - Sending MAIL FROM command: [email protected]
2024-05-04 23:35:49,587 - DEBUG - RCPT TO response: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1  https://support.google.com/mail/?p=NoSuchUser p14-20020aa7d30e000000b00572d0cb1e66si1718373edq.661 - gsmtp"
2024-05-04 23:35:49,600 - DEBUG - RCPT TO response: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1  https://support.google.com/mail/?p=NoSuchUser wg10-20020a17090705ca00b00a5999e2028dsi2138359ejb.514 - gsmtp"
2024-05-04 23:35:49,639 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:49,639 - DEBUG - Sending RCPT TO command for: [email protected]
2024-05-04 23:35:49,646 - DEBUG - SMTP session closed
2024-05-04 23:35:49,651 - DEBUG - RCPT TO response: 250, b'2.1.5 OK j7-20020a5d5647000000b0034cfd826251si3647095wrw.519 - gsmtp'
2024-05-04 23:35:49,665 - DEBUG - RCPT TO response: 250, b'2.1.5 OK m8-20020a056402430800b005721e7edb0fsi3177955edc.665 - gsmtp'
2024-05-04 23:35:49,666 - DEBUG - SMTP session closed
2024-05-04 23:35:49,672 - DEBUG - SMTP session closed
2024-05-04 23:35:49,675 - DEBUG - SMTP session closed
2024-05-04 23:35:49,694 - DEBUG - SMTP session closed
2024-05-04 23:35:49,709 - DEBUG - RCPT TO response: 250, b'2.1.5 Recipient OK'
2024-05-04 23:35:49,752 - DEBUG - SMTP session closed
2024-05-04 23:35:49,753 - DEBUG - SMTP session closed
2024-05-04 23:35:49,761 - DEBUG - SMTP session closed
2024-05-04 23:35:50,085 - DEBUG - Connecting to SMTP server alt2.gmail-smtp-in.l.google.com. on port 25
2024-05-04 23:35:50,086 - DEBUG - Connecting to SMTP server alt2.gmail-smtp-in.l.google.com. on port 25
2024-05-04 23:35:50,086 - DEBUG - Connecting to SMTP server mta6.am0.yahoodns.net. on port 25
2024-05-04 23:35:50,086 - DEBUG - Connecting to SMTP server outlook-com.olc.protection.outlook.com. on port 25
2024-05-04 23:35:50,314 - DEBUG - SMTP connection established
2024-05-04 23:35:50,314 - DEBUG - SMTP connection established
2024-05-04 23:35:50,402 - DEBUG - EHLO command sent
2024-05-04 23:35:50,402 - DEBUG - Sending MAIL FROM command: [email protected]
2024-05-04 23:35:50,407 - DEBUG - EHLO command sent
2024-05-04 23:35:50,407 - DEBUG - Sending MAIL FROM command: [email protected]
2024-05-04 23:35:50,451 - DEBUG - SMTP connection established
2024-05-04 23:35:50,472 - DEBUG - EHLO command sent
2024-05-04 23:35:50,472 - DEBUG - Sending MAIL FROM command: [email protected]
2024-05-04 23:35:50,484 - DEBUG - SMTP connection established
2024-05-04 23:35:50,486 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:50,486 - DEBUG - Sending RCPT TO command for: [email protected]
2024-05-04 23:35:50,492 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:50,493 - DEBUG - Sending RCPT TO command for: [email protected]
2024-05-04 23:35:50,497 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:50,498 - DEBUG - Sending RCPT TO command for: [email protected]
2024-05-04 23:35:50,525 - DEBUG - RCPT TO response: 250, b'2.1.5 Recipient OK'
2024-05-04 23:35:50,545 - DEBUG - SMTP session closed
2024-05-04 23:35:50,561 - DEBUG - EHLO command sent
2024-05-04 23:35:50,561 - DEBUG - Sending MAIL FROM command: [email protected]
2024-05-04 23:35:50,575 - DEBUG - RCPT TO response: 550, b"5.1.1 The email account that you tried to reach does not exist. Please try\n5.1.1 double-checking the recipient's email address for typos or\n5.1.1 unnecessary spaces. For more information, go to\n5.1.1  https://support.google.com/mail/?p=NoSuchUser w9-20020a5d4049000000b0034ddab36ff8si3678827wrp.499 - gsmtp"
2024-05-04 23:35:50,641 - DEBUG - MAIL FROM command sent successfully
2024-05-04 23:35:50,641 - DEBUG - Sending RCPT TO command for: [email protected]
2024-05-04 23:35:50,659 - DEBUG - SMTP session closed
2024-05-04 23:35:50,710 - DEBUG - RCPT TO response: 250, b'2.1.5 OK d7-20020a05600c34c700b0041d7d5787bfsi3791910wmq.193 - gsmtp'
2024-05-04 23:35:50,720 - DEBUG - RCPT TO response: 250, b'recipient <[email protected]> ok'
2024-05-04 23:35:50,801 - DEBUG - SMTP session closed
2024-05-04 23:35:50,802 - DEBUG - SMTP session closed

syntax only test without smtp and dns test

python validate_emails.py -f [email protected] -e [email protected] -tm syntax
[
    {
        "email": "[email protected]",
        "status": "valid_format",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_format",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_format",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_format",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_format",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_format",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_format",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_format",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_format",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_format",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_format",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_format",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_format",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_format",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "notchecked"
    },
    {
        "email": "[email protected]",
        "status": "valid_format",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "notchecked"
    }
]

API Support

In additional to local self-hosted email verification, the script now has added support for the following external Email cleaning service APIs - EmailListVerify, MillionVerifier, MyEmailVerifier, CaptainVerify, Proofy.io, Zerobounce, Reoon, Bouncify, Bounceless. Links to services maybe affiliate links. If you found this information useful ;)

Updated: Added API Merge support via -apimerge argument to merge EmailListVerify + MillionVerifier API results together for more accurate email verification results.

API Usage Commands

validate_emails.py supports passing individual email's comma separated via -e flag i.e. -e [email protected],[email protected] or passing -l flag for a text file with list of email addresses one per line via -l emaillist.txt. Both methods use respetive provider's per email verification APIs. Only some providers have support in the script for bulk email API - which is currently EmailListVerify and MillionVerifier via -apibulk flag i.e. -l emaillist.txt -apibulk emaillistverify or -l emaillist.txt -apibuilk millionverifier.

You can see a full list and explanation of all argument flags supported at here.

The -api flag determines which provider you use along with their respective -apikey* flag.

EmailListVerify

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey

MillionVerifier

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey

CaptainVerify

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api captainverify -apikey_cv $cvkey

Proofy.io

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api proofy -apikey_pf $pkey -apiuser_pf $puser

MyEmailVerifier

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api myemailverifier -apikey_mev $mevkey

Zerobounce

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api zerobounce -apikey_zb $zbkey

Reoon

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api reoon -apikey_rn $reokey

Bouncify

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api bouncify -apikey_bf $bfkey

Bounceless

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api bounceless -apikey_bf $blkey

Notes:

Personal Experience

Personal experience with all commercial email verification providers:

  • Disclaimer: I've already been using EmailListVerify since 2015 and Proofy.io since 2022. While the rest of the mentioned providers are new experiences for me.

  • EmailListVerify and MillionVerifier while being cheaper than the others seem to be better for the following:

    • API documentation
    • Less restrictive on API connection and rate limits. Meaning if you are doing per email API checks for many email addresses, the speed of completion will be faster. Though if you're doing many email address checks, you'd want to use their respective bulk email API end points to upload a single text file for processing.
    • For bulk API speed though, MillionVerifier is much faster than EmailListVerify. Even MillionVerifier's per email check API speed can be as low as 100ms for check and has a rate limit of 400 emails/second per unqiue IP address. For the sample 15 email addresses tested below, MillionVerifier bulk API took ~7 seconds, EmailListVerify bulk API took ~45 seconds. Compared to per email address verification checks, both taking between 2.2 to 3.3 seconds. EmailListVerify seems to have much more detailed status classifications (see below) compared to ther others so more processing is done on their end.
  • MillionVerifier has email verification speed information here

  • MillionVerifier allow for a maximum 2 simultaneous bulk file API uploads at a time and max size of files uploaded are 1 million emails per file or 100MB size. If each of the files contains more than 1000 emails, they will verify a maximum of 2 files at a time.

  • MillionVerifier API logging for billing is the mosted detailed with historical running balances. They also show per API call credit usage balance details and even list in the logs refunded credits for bulk API file uploaded emails classified as 'risky' (catch_all or unknown) https://help.millionverifier.com/payments-credits/refund-for-risky-emails. AFAIK, the other providers don't refund any credits that I can see. However, on below sample 15 email addresses tested, I always got 1 refunded credit so it applies to one email address which is a known valid email [email protected] which is classed as unknown in bulk API but classed as ok in per email verification API. Seems to be a bug in their bulk API then as the refunds only apply to bulk API and not per email verification checks due to differences in classifications in bulk API vs per email verification API.

    MillionVerifier Yahoo Email Address

    I reached out to MillionVerifier chat support which was initially handled via Milly their AI chat bot which later referred me to support. They emailed me back saying:

    We're glad you reached out to us about this issue, and we're here to help. The discrepancy you're seeing in the results is likely because we were unable to connect to the server during the verification process, leading to an "Unknown" result. However, for the single API, the connection went through smoothly, allowing us to verify the email without any problems. An "Unknown" result simply means that we couldn't determine the existence of the email at the time of verification. If you have any more questions, queries, or issues, we're more than happy to assist.

    I tried a few attempts at bulk API for the same list of 15 emails, and [email protected] is always marked as status = unknown and never anything different though? It would be hard to differentiate status classifications if it's due connection issues if they're lumped into other emails in unknown label. Maybe would be better to have a separate classification for connection issues so we can differentiate as such. For example, EmailListVerify has 18 different status classifications including for connection related issues.

    MillionVerifier follow up - support investigated the issue on their end and said:

    We're really glad you reached out to us about this issue, and we've done our best to get to the bottom of it. Thank you for your patience while we looked into this. It turns out the issue wasn't about whether you were verifying emails in bulk or one at a time, but rather which server was used for the verification. Also, if you try to verify some emails multiple times, they might eventually return an "Unknown" result. I'd also like to point out that we don't deduct credits for emails marked as "Risky" during API calls. You won't see a credit refund for these in your Credit Balance because we only charge for emails identified as "Good" or "Bad." > The credits for "Risky" emails aren't taken away in the first place.

    I confirmed this occurs on MillionVerifier single email verification as well if you test it enough times for [email protected] email address specifically.

    single email API check for [email protected] returns ok

    python validate_emails.py -f [email protected] -e [email protected] -api millionverifier -apikey_mv $mvkey -tm all
    [
        {
            "email": "[email protected]",
            "status": "ok",
            "status_code": null,
            "free_email": "yes",
            "disposable_email": "no",
            "free_email_api": true,
            "role_api": false
        }
    ]
    

    bulk API upload check excerpt for [email protected] returns unknown

    python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey -apibulk millionverifier
    [
     
        {
            "email": "[email protected]",
            "status": "unknown",
            "free_email": "yes",
            "disposable_email": "no",
            "free_email_api": "yes",
            "role_api": "no"
        },
    
    ]
    

    As such you can't 100% rely on the status output to do tasks like updating Xenforo user's user_state status to stop sending emails to them without further verification for such emails. For now, I've updated my validate_emails.py script for MillionVerifier bulk API and per email check API results, to not list Xenforo SQL queries for unknown status results and only list Xenforo SQL queries for invalid and disposable status emails. Same can be said for other providers, probably need to really double check your results if you're relying on the results for important tasks. You can filter MillionVerifier's unknown status emails and feed them into another commercial provider's API to double check i.e. EmailListVerify or use script's self-hosted local email check. Given cheaper MillionVerifier pricing, it might be more economical to do it this way?

    MillionVerifier bulk API filter -api millionverifier -apikey_mv $mvkey -apibulk millionverifier filter using jq for unknown status emails piped into text file results-millionverifier-bulk-api-unknown-only.txt

    python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey -apibulk millionverifier | jq '.[] | select(.status == "unknown")' 2>&1 > results-millionverifier-bulk-api-unknown-only.txt
    

    The results-millionverifier-bulk-api-unknown-only.txt contents will show all MillionVerifier bulk API returned unknown status results.

    cat results-millionverifier-bulk-api-unknown-only.txt                                            
    {
      "email": "[email protected]",
      "status": "unknown",
      "free_email": "yes",
      "disposable_email": "no",
      "free_email_api": "yes",
      "role_api": "no"
    }
    

    Using same results-millionverifier-bulk-api-unknown-only.txt file, and jq just filter out the email addresses into a new results-millionverifier-bulk-api-unknown-only-emails.txt file

    cat results-millionverifier-bulk-api-unknown-only.txt | jq -r '.email' | tee results-millionverifier-bulk-api-unknown-only-emails.txt
    [email protected]
    

    Then use EmailListVerify bulk API to verify the filtered MillionVerifier unknown status list filtered file results-millionverifier-bulk-api-unknown-only-emails.txt and double check the status which confirms it's actually a valid email.

    python validate_emails.py -f [email protected] -l results-millionverifier-bulk-api-unknown-only-emails.txt -tm all -api emaillistverify -apikey $elvkey -apibulk emaillistverify
    
    [
        {
            "email": "[email protected]",
            "status": "valid",
            "status_code": "",
            "free_email": "yes",
            "disposable_email": "no"
        }
    ]
    

    Or EmailListVerify per email verification API check

    ./validate_emails.py -f [email protected] -e [email protected] -tm all -api emaillistverify -apikey $elvkey -tm all
    [
        {
            "email": "[email protected]",
            "status": "valid",
            "status_code": null,
            "free_email": "yes",
            "disposable_email": "no"
        }
    ]
    

    Or if it's a few emails, via validate_emails.py script's self-hosted local email syntax, DNS and SMTP check

      validate_emails.py -f [email protected] -e [email protected] -tm all
    [
        {
            "email": "[email protected]",
            "status": "ok",
            "status_code": 250,
            "free_email": "yes",
            "disposable_email": "no"
        }
    ]
    
  • MyEmailVerifier API is limited to 30 requests per minute for per email address verification checks. For the sample 15 email addresses tested below, took ~5.5 seconds to complete per email address verification checks

  • MyEmailVerifier API logging doesn't seem to work. Waited a few days and none of my API tests were logged in their API logging on their dashboard web site.

  • CaptainVerify API is limited to a maximum of 2 simultaneous connections and 50 checks per minute for per email address verification checks. For the sample 15 email addresses tested below, took ~4.6 seconds to complete per email address verification checks

  • Proofy.io has the most restrictive API limits but I can't seem to find any documentation of the actual limits, so I have to code it so it isn't as fast as other providers for per email verification checks. It will be the slowest of the 5 providers for per email verification checks. For the sample 15 email addresses tested below, took ~9.5 seconds to complete per email address verification checks

  • Proofy.io only has single email check and batch email checks but no bulk file API support.

  • ZeroBounce API was added on May 11, 2024. For sample 15 email addresses, it took 4.794 seconds via per email check API. They have 100 free email credits per month, making it possible to keep my script's support and development testing costs down to a minimum. API documentation is very well documented.

  • ZeroBounce, only annoying issues right now are on their web site end and not their API specifically:

    1. initial login to web site dashboard are very slow as is reloading the dashboard i.e. browser F5 refresh. Sometimes just stuck with their purple reloading page progress icon that never actually loads the web page/dashboard.
    2. the web site login session durations are very short, so annoyingly you get logged out very quickly making it more secure. Make sure you use a password manager to make re-logins less annoying. Though if you're using a script and their API, you don't have to login as frequently.
  • ZeroBounce offers per email, batch email and bulk file API endpoints.

  • ZeroBounce doesn't charge for unknown status emails

  • ZeroBounce API rate limit speeds are outlined in there documentation here - 50,000 requests in 10 seconds (validations) before temporarily blocking for 1 minute. A maximum of 250 requests in 1 minute for the bulkapi.zerobounce.net/ before temporarily blocking for 1 hour. And allow a maximum of 20 requests in 1 minute for the bulkapi.zerobounce.net/v2/validatebatch before temporarily blocking for 10 minutes. Rate limits seem more complicated so will need to test my script to ensure it operates under their rate limits.

  • Reoon as added on May 12, 2024 and per email verification API should be kept at less than 5 concurrent threads. They say they take around 20 minutes to verify a set of 50,000 mixed-quality email addresses. For bulk email API, max is 50,000 emails per list. A bit on the low side given some other providers allow a max 1 million emails per list. The 15 email address sameple test took 2.176 seconds to complete.

  • Reoon unfortunately incorrectly classified [email protected] as a valid email when it isn't and marked by all other APIs as invalid/undeliverable/email_disabled. This seems to be due to Reoon having 2 modes for their single email verification API for a quick and power modes. My initial tests are with quick mode. But I will need to do testing with power mode in future. Even their web site dashboard based single email verification check returns correct invalid status for this email suggesting they used power mode there too. I honestly do not know why anyone would use quick mode given how common Gmail email addresses are.

    • From their documentation:
      • The disadvantages of quick mode verification: Deep verification and detailed information are less available compared to the POWER mode. So individual inbox status will not be checked in this mode. The quick verification mode includes:
        • Email syntax validation.
        • Disposable/temporary email check.
        • MX validation and records.
        • Domain email acceptance validation.
        • Invalid email detection.
        • Expired/invalid domain detection.
        • Role account check.
  • Reoon doesn't charge for unknown status emails

  • Reoon do not store any uploaded data for more than 15 days

  • Reon has detailed API credit usage and balance logs just like MillionVerifier

  • Bouncify was added May 12, 2024 and seems to be the slowest to date for API response for single email and 15 sample email address API tests took 184+ seconds even though they have a 120 concurrent request API limit and seem to have trouble validating the @yahoo.com and @hotmail.com accounts in my 15 email address sample list here.

  • Bouncessless was added May 14, 2024. Probably the 2nd or 3rd slowest per email address verification APIs and seems highly inaccurate on 15 email address sample list not a single known valid email address was deemed as valid by the API. Instead the valid email addresses were all deemed unknown. After 1/2 day later I retested and Bounceless now fluctuates between an unknown and valid status for known Gmail address. So doesn't seem as reliable for detecting Gmail email addresses compared to other email verification providers tested and compared in the Email Verification Results Table. Bounceless API also doesn't recognise Gmail/Workspace emails using + alias i.e. [email protected] and deems them as invalid syntax! I double checked this on their web site dashboard and [email protected] email address was still marked as invalid syntax.

  • The number of API returned status value classifications returned by the various providers differs. Some have a more detailed classifications for emails than others.

    • EmailListVerify has 18 classifications:
      • ok
      • error
      • invalid_mx
      • smtp_error
      • smtp_protocol
      • unknown_email
      • attempt_rejected
      • relay_error
      • antispam_system
      • email_disabled
      • domain_error
      • ok_for_all
      • dead_server
      • syntax_error
      • unknown
      • accept_all
      • disposable
      • spamtrap
    • MillionVerifier has 5 classifications:
      • ok
      • catch_all
      • unknown
      • disposable
      • invalid
    • MyEmailVerifier has 4 classifications:
      • valid
      • invalid
      • catch-all
      • unknown
    • CaptainVerify has 4 classifications:
      • valid
      • invalid
      • risky
      • unknown
    • Proofy.io has 4 classifications:
      • deliverable
      • risky
      • undeliverable
      • unknown
    • ZeroBounce has 7 classifications and also 23 sub_status classifications:
      • classifications:
        • valid
        • invalid
        • catch-all
        • unknown
        • spamtrap
        • abuse
        • do_not_mail
      • sub_status classifications:
        • alternate
        • antispam_system
        • greylisted
        • mail_server_temporary_error
        • forcible_disconnect
        • mail_server_did_not_respond
        • timeout_exceeded
        • failed_smtp_connection
        • mailbox_quota_exceeded
        • exception_occurred
        • possible_trap
        • role_based
        • global_suppression
        • mailbox_not_found
        • no_dns_entries
        • failed_syntax_check
        • possible_typo
        • unroutable_ip_address
        • leading_period_removed
        • does_not_accept_mail
        • alias_address
        • role_based_catch_all
        • disposable, toxic
    • Reoon has 4 classifications
      • valid
      • invalid
      • disposable
      • spamtrap
    • Bouncify has 4 classifications
      • deliverable
      • undeliverable
      • unknown
      • accept-all
    • Bounceless has 10 classifications
      • blacklist
      • catch_all
      • disposable
      • invalid
      • no_mx_record
      • role
      • timeout
      • unknown
      • valid
      • spamtrap

Email Verification Provider Comparison Costs

Below are their respectivate pay as you go credit pricing for email verifications. The usual recommendations are to verify your lists every 3-6 months which is 2-4x times per year or prior to a large email sending campaign. Have a 25K email list = 2-4 x 25K = 50-100K email verifications per year.

  • Updates:
    • May 11, 2024 add Zerobounce API support
    • May 12, 2024 add Reoon API support
    • May 12, 2024 add Bouncify API support
    • May 14, 2024 add Bounceless API support - seems there's difference in pricing for 500K on their web site at US$649 but logged into my dashboard pricing is US$799.

Notes:

Provider 1k 2k 5k 10k 25k 30k 50k 70k 100k
EmailListVerify (demo, results) $4 (0.0008) 💲 - $15 (0.003) 💲 $24 (0.0024) $49 (0.00196) - $89 (0.00178) - $169 (0.00169)
MillionVerifier (demo, results) - - - $37 (0.0037) $49 (0.00196) - $77 (0.00154) - $129 (0.00129)
MyEmailVerifier (demo, results) - $14 (0.007) 💲 $28 (0.0056) $39 (0.0039) $79 (0.00316) - $149 (0.00298) - $239 (0.00239)
CaptainVerify (demo, results) $7 (0.007) - $30 (0.006) $60 (0.006) $75 (0.003) - $150 (0.003) - $200 (0.002)
Proofy.io (demo, results) - - $16 (0.0032) $29 (0.0029) - $63 (0.0021) $99 (0.00198) $124 (0.00177) $149 (0.00149)
Zerobounce (demo, results) - $20 (0.01) $45 (0.009) $80 (0.008) $190 (0.0076) - $375 (0.0075) - $425 (0.00425)
Reoon (demo, results) - - - $11.91 (0.00119) 💲 $29.66 (0.00119) 💲 - $58.95 (0.00118) 💲 $87.86 (0.00126) 💲 $116.40 (0.00116)
Bouncify (demo, results) - - - $19 (0.0019) - $39 (0.0013) 💲 - - $99 (0.001) 💲
Bounceless (demo, results) - - $29 (0.0058) - $99 (0.00396) - - - $299 (0.00299)
Provider 200k 250k 300k 500k 1m 2.5m 5m 10m
EmailListVerify (demo, results) - $349 (0.001396) - $449 (0.000898) $599 (0.000599) $1190 (0.000476) 💲 $1990 (0.000398) $3290 (0.000329)
MillionVerifier (demo, results) - - - $259 (0.000518) 💲 $389 (0.000389) 💲 - $1439 (0.000288) 💲 $2529 (0.000253) 💲
MyEmailVerifier (demo, results) - $349 (0.001396) - $549 (0.001098) $749 (0.000749) $1249 (0.0005) $1849 (0.00037) -
CaptainVerify (demo, results) - $250 (0.001) 💲 - $500 (0.001) $650 (0.00065) - $2000 (0.0004) -
Proofy.io (demo, results) $229 (0.001145) - $289 (0.000963) 💲 $429 (0.000858) $699 (0.000699) $1399 (0.00056) - -
Zerobounce (demo, results) - $940 (0.00376) - $1800 (0.0036) $2750 (0.00275) - - -
Reoon (demo, results) $226.80 (0.00113) $279.75 (0.00112) $331.20 (0.00110) $522.00 (0.00104) $960.00 (0.00096) - - -
Bouncify (demo, results) $149 (0.00075) 💲 - - $279 (0.00056) $479 (0.00048) - - -
Bounceless (demo, results) - - - $649 (0.001298) $899 (0.000899) - - -

Email Verification Provider API Speed & Rate Limits

From fastest to slowest ranked from my API tests overall and from gathered API documentation from each respective email verification provider's web site. Speed wise on command line, EmailListVerify and MillionVerifier are neck and neck on per email verification API checks. However, for bulk file API email verification checks, MillionVerifier wins by a lot. Also added tests as a PHP Wrapper where each API providers' times performed differently compared to command line run tests.

MillionVerifier has more detailed email verification speed information for the bulk file email verification here which I assume is for the web site dashboard and not for their API.

Updated: May 11, 2024 add Zerobounce API support. ZeroBounce API rate limit speeds are outlined in there documentation here and will update the below table after I have done some tests.

Updated: May 12, 2024

  • add Reoon API support. Will update below table after I have done some tests.
  • add Bouncify API support. Will update below table after I have done some tests.

Updated: May 14, 2024

  • add Bounceless API support. Will update below table after I have done some tests.

Table also takes into account API rate limits besides my single and 15 email address sample tests. For example, if CaptainVerify takes 20+ seconds to verify a single email address and MyEmailVerifier takes 2-3 seconds, then the higher rate limit per min of CaptainVerify wouldn't matter as CaptainVerify would only be able to handle 3 emails/min versus MyEmailVerifier 20-30 emails/min.

Provider Rank For API Speed emails/sec emails/min
1. Zerobounce 50,000 per 10s but 1 min block no doc mention
2. MillionVerifier 400/s no doc mention
3. EmailListVerify no doc mention no doc mention
4. Reoon no doc mention no doc mention
5. MyEmailVerifier no doc mention 30/min
6. CaptainVerify no doc mention 50/min
7. Proofy.io no doc mention no doc mention
8. Bounceless no doc mention no doc mention
9. Bouncify no doc mention 120/min

Email Verification Provider API Speed Benchmarks

Prior to May 16, 2024, the focus for speed of API returned results as based on validate_emails.py completion time, but the Python script uses concurrent threads defined by optional script argument -wf for worker factor to process per email verifications when there's more than 1 email address to process. By default -wf worker factor controlled how many threads were used in validate_emails.py and it defaults to a value of 16 for all API providers except CaptainVerify API and MyEmailVerifier API due to their more restrictive API rate limits, I had to set -wf worker factor to default to 1. As of May 18 2024, Reoon has set -wf to 5 to adhere to their single email address verification API limit of 5 threads maximum. This results in timed validate_emails.py script run completion being slower for CaptainVerify API and MyEmailVerifier API to ensure any API requests do not exceed their respective API rate limits.

So to properly calculate per email verification API response time api_response_time and api_thread_number thread pool number, I also added these metrics to the API JSON response. So to do a email verification check for [email protected], the API response took 2.0609 seconds while validate_emails.py script run took 4.313 seconds using thread pool 0_0. However, you have to remember that overall speed will depend on the individual API response time and would need to factor in the respective email verification provider's API rate limits.

time python validate_emails.py -f [email protected] -e [email protected] -tm all -api emaillistverify -apikey $elvkey
[
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "api_response_time": 2.0609,
        "api_thread_number": "thread-pool-0_0"
    }
]

real    0m4.313s
user    0m0.352s
sys     0m0.029s

With api_response_time and api_thread_number now available in JSON result output, I can now benchmark all tested email verification API providers more accurately for per email verification API response times. Below are the tabulated comparison results. I didn't test Proofy API as I ran out of credits and Proofy doesn't have a bulk file API support and Bounceless API wasn't worth testing given it's inaccurate results for Gmail accounts.

The benchmark tests were against the 15 email address sample list -l emaillist.txt from the commands

# [EmailListVerify](https://centminmod.com/emaillistverify)
python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey

# [MillionVerifier](https://centminmod.com/millionverifier)
python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey

# [CaptainVerify](https://centminmod.com/captainverify)
python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api captainverify -apikey_cv $cvkey

# [MyEmailVerifier](https://centminmod.com/myemailverifier)
python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api myemailverifier -apikey_mev $mevkey

# [Zerobounce](https://centminmod.com/zerobounce)
python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api zerobounce -apikey_zb $zbkey

# [Reoon](https://centminmod.com/reoon)
python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api reoon -apikey_rn $reokey

# [Bouncify](https://centminmod.com/bouncify)
python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api bouncify -apikey_bf $bfkey

First table provides the average, min, median, max and 99th percentile API response times for all 15 email addresses broken down by email verification API provider. The table is ordered by provider name alphabetically.

Providers ranked from fastest to slowest for average and maximum API response times for all 15 email addresses checked:

Ranked by Average API Response Time (fastest to slowest) for all 15 email addresses checked:

  1. zerobounce: Average API Response Time = 0.3922 seconds
  2. millionverifier: Average API Response Time = 0.4649 seconds
  3. emaillistverify: Average API Response Time = 1.3805 seconds
  4. reoon: Average API Response Time = 1.3850 seconds
  5. captainverify: Average API Response Time = 2.1669 seconds
  6. myemailverifier: Average API Response Time = 3.9018 seconds
  7. bouncify: Average API Response Time = 13.3857 seconds

Ranked by Maximum API Response Time (fastest to slowest) for all 15 email addresses checked:

  1. millionverifier: Max API Response Time = 0.5481 seconds
  2. zerobounce: Max API Response Time = 1.0279 seconds
  3. reoon: Max API Response Time = 3.0198 seconds
  4. emaillistverify: Max API Response Time = 3.1766 seconds
  5. myemailverifier: Max API Response Time = 4.903 seconds
  6. captainverify: Max API Response Time = 21.5099 seconds
  7. bouncify: Max API Response Time = 180.6231 seconds

From the data, we can observe that:

  • Zerobounce and MillionVerifier are the fastest email verification API providers in terms of both average and maximum API response times. Zerobounce's average API response times was held back by slow [email protected] verification check at 1.0279seconds (though it was still the fastest API response time that had an accurate status). MillionVerifier's average API response times was held back by several checks >0.5 seconds with slowest [email protected] verification checks 0.5481 seconds.
  • If you removed the slowest check for Zerobounce, the remaining 14 sample email addresses would of had an average API response time of 0.347 seconds.
  • If you removed the slowest check for MillionVerifier, the remaining 14 sample email addresses would of had an average API response time of 0.459 seconds.
  • MillionVerifier overall would be fastest if you take into account the max API response times.
  • Bouncify is the slowest provider, with the highest average and maximum API response times by a significant margin. The email check for [email protected] retuned an api_error and API response time for that check was 180.6231 seconds. If you excluded the api_error timed result, the average API response time for remaining 14 sample email addresses would of been 1.44 seconds.
  • CaptainVerify has a relatively high maximum API response time of 21.5099 seconds (due to the email check for [email protected]), although its average response time is better than Bouncify and MyEmailVerifier.
  • Reoon, EmailListVerify, and MyEmailVerifier have relatively similar average and maximum API response times, ranking in the mid-range among the providers.
  • However, you have to remember that overall speed will depend on the individual API response time and would need to factor in the respective email verification provider's API rate limits.
API Provider Average api_response_time Min api_response_time Median api_response_time Max api_response_time 99th Percentile api_response_time
bouncify 13.3857 0.6154 1.3655 180.6231 180.6231
captainverify 2.1669 0.501 0.5793 21.5099 21.5099
emaillistverify 1.3805 0.6449 1.1035 3.1766 3.1766
millionverifier 0.4649 0.4145 0.4442 0.5481 0.5481
myemailverifier 3.9018 2.631 4.0985 4.903 4.903
reoon 1.3850 0.7275 1.3763 3.0198 3.0198
zerobounce 0.3922 0.259 0.3464 1.0279 1.0279

Next comparison table shows each of the 15 sample email addresses' individual API response times, returned status check results and also the validated_emails.py script's execution times. Email addresses are sorted alphabetically.

Pay attention to specific email addresses compared for the accuracy of the email verification providers's API results:

Notes:

  • For status results that I know are incorrect, I've marked them with ❌ next to the result.
  • For api_response_time added 🏆 for fastest times for each email verification. For [email protected] the fastest inaccurate and accurate results were both marked.
email API Provider status api_response_time free_email disposable_email api_thread_number validated_emails.py Time
[email protected] bouncify undeliverable 1.0689 no no thread-pool-0_5 181.576
[email protected] captainverify invalid 0.5636 no no thread-pool-0_5 22.836
[email protected] emaillistverify email_disabled 1.0654 no no thread-pool-0_5 4.208
[email protected] millionverifier invalid 0.5352 no no thread-pool-0_5 1.614
[email protected] myemailverifier invalid 4.663 no no thread-pool-0_5 6.461
[email protected] reoon unknown 0.7413 no no thread-pool-0_5 5.744
[email protected] zerobounce invalid 0.4128 🏆 no no thread-pool-0_5 2.930
[email protected] bouncify undeliverable 2.7131 no no thread-pool-0_4 181.576
[email protected] captainverify invalid 0.5862 no no thread-pool-0_4 22.836
[email protected] emaillistverify email_disabled 1.0523 no no thread-pool-0_4 4.208
[email protected] millionverifier invalid 0.4321 no no thread-pool-0_4 1.614
[email protected] myemailverifier invalid 4.903 no no thread-pool-0_4 6.461
[email protected] reoon unknown 1.655 no no thread-pool-0_4 5.744
[email protected] zerobounce invalid 0.259 🏆 no no thread-pool-0_4 2.930
[email protected] bouncify deliverable 2.0478 no no thread-pool-0_9 181.576
[email protected] captainverify invalid 0.5693 no no thread-pool-0_9 22.836
[email protected] emaillistverify valid 1.3723 no no thread-pool-0_9 4.208
[email protected] millionverifier ok 0.4314 no no thread-pool-0_9 1.614
[email protected] myemailverifier valid 3.9004 no no thread-pool-0_9 6.461
[email protected] reoon role_account 1.478 no no thread-pool-0_9 5.744
[email protected] zerobounce do_not_mail 0.3873 🏆 no no thread-pool-0_9 2.930
[email protected] bouncify undeliverable 1.3655 yes no thread-pool-0_11 181.576
[email protected] captainverify invalid 0.5564 no no thread-pool-0_11 22.836
[email protected] emaillistverify email_disabled 1.3844 yes no thread-pool-0_11 4.208
[email protected] millionverifier invalid 0.4443 yes no thread-pool-0_11 1.614
[email protected] myemailverifier invalid 4.5972 yes no thread-pool-0_11 6.461
[email protected] reoon invalid 0.9289 yes no thread-pool-0_11 5.744
[email protected] zerobounce invalid 0.3605 🏆 yes no thread-pool-0_11 2.930
[email protected] bouncify undeliverable 2.0223 no no thread-pool-0_7 181.576
[email protected] captainverify invalid 0.5787 no no thread-pool-0_7 22.836
[email protected] emaillistverify email_disabled 1.0572 no no thread-pool-0_7 4.208
[email protected] millionverifier invalid 0.4273 no no thread-pool-0_7 1.614
[email protected] myemailverifier invalid 4.1387 no no thread-pool-0_7 6.461
[email protected] reoon invalid 1.0709 no no thread-pool-0_7 5.744
[email protected] zerobounce invalid 0.3377 🏆 no no thread-pool-0_7 2.930
[email protected] bouncify undeliverable 0.9657 no no thread-pool-0_6 181.576
[email protected] captainverify invalid 0.5909 no no thread-pool-0_6 22.836
[email protected] emaillistverify email_disabled 1.0636 no no thread-pool-0_6 4.208
[email protected] millionverifier invalid 0.5378 no no thread-pool-0_6 1.614
[email protected] myemailverifier invalid 3.396 no no thread-pool-0_6 6.461
[email protected] reoon invalid 1.5885 no no thread-pool-0_6 5.744
[email protected] zerobounce invalid 0.3464 🏆 no no thread-pool-0_6 2.930
[email protected] bouncify deliverable 2.6186 no no thread-pool-0_2 181.576
[email protected] captainverify invalid ❌ 0.6153 no no thread-pool-0_2 22.836
[email protected] emaillistverify valid 0.8685 no no thread-pool-0_2 4.208
[email protected] millionverifier ok 0.4145 no no thread-pool-0_2 1.614
[email protected] myemailverifier valid 3.002 no no thread-pool-0_2 6.461
[email protected] reoon valid 1.6539 no no thread-pool-0_2 5.744
[email protected] zerobounce valid 0.3708 🏆 no no thread-pool-0_2 2.930
[email protected] bouncify deliverable 1.6912 yes no thread-pool-0_13 181.576
[email protected] captainverify valid 3.5499 yes no thread-pool-0_13 22.836
[email protected] emaillistverify valid 1.1035 yes no thread-pool-0_13 4.208
[email protected] millionverifier ok 0.4181 yes no thread-pool-0_13 1.614
[email protected] myemailverifier valid 4.6978 yes no thread-pool-0_13 6.461
[email protected] reoon valid 1.453 yes no thread-pool-0_13 5.744
[email protected] zerobounce valid 0.3327 🏆 yes no thread-pool-0_13 2.930
[email protected] bouncify api_error ❌ 180.6231 yes no thread-pool-0_14 181.576
[email protected] captainverify invalid 0.5793 no no thread-pool-0_14 22.836
[email protected] emaillistverify valid 0.6449 yes no thread-pool-0_14 4.208
[email protected] millionverifier ok 0.4245 yes no thread-pool-0_14 1.614
[email protected] myemailverifier valid 4.1951 yes no thread-pool-0_14 6.461
[email protected] reoon valid 1.3763 yes no thread-pool-0_14 5.744
[email protected] zerobounce valid 0.3696 🏆 yes no thread-pool-0_14 2.930
[email protected] bouncify deliverable 0.678 yes no thread-pool-0_10 181.576
[email protected] captainverify valid 0.5302 yes no thread-pool-0_10 22.836
[email protected] emaillistverify valid 1.3648 yes no thread-pool-0_10 4.208
[email protected] millionverifier ok 0.4417 yes no thread-pool-0_10 1.614
[email protected] myemailverifier valid 2.631 yes no thread-pool-0_10 6.461
[email protected] reoon valid 1.1321 yes no thread-pool-0_10 5.744
[email protected] zerobounce valid 0.3301 🏆 yes no thread-pool-0_10 2.930
[email protected] bouncify undeliverable 0.825 yes yes thread-pool-0_0 181.576
[email protected] captainverify risky 0.501 no yes thread-pool-0_0 22.836
[email protected] emaillistverify unknown 2.0574 yes yes thread-pool-0_0 4.208
[email protected] millionverifier disposable 0.516 yes yes thread-pool-0_0 1.614
[email protected] myemailverifier invalid 3.8669 yes yes thread-pool-0_0 6.461
[email protected] reoon disposable 3.0198 yes yes thread-pool-0_0 5.744
[email protected] zerobounce do_not_mail 0.3632 🏆 yes yes thread-pool-0_0 2.930
[email protected] bouncify undeliverable 0.6154 no yes thread-pool-0_8 181.576
[email protected] captainverify invalid 0.5697 no no thread-pool-0_8 22.836
[email protected] emaillistverify unknown 2.0571 no yes thread-pool-0_8 4.208
[email protected] millionverifier disposable 0.5481 no yes thread-pool-0_8 1.614
[email protected] myemailverifier invalid 4.1935 no yes thread-pool-0_8 6.461
[email protected] reoon disposable 1.0481 yes yes thread-pool-0_8 5.744
[email protected] zerobounce do_not_mail 0.3356 🏆 no yes thread-pool-0_8 2.930
[email protected] bouncify accept-all ❌ 0.7072 yes no thread-pool-0_12 181.576
[email protected] captainverify invalid ❌ 0.597 no no thread-pool-0_12 22.836
[email protected] emaillistverify valid 1.3502 yes no thread-pool-0_12 4.208
[email protected] millionverifier unknown ❌ 0.5145 🏆 yes no thread-pool-0_12 1.614
[email protected] myemailverifier valid 3.118 yes no thread-pool-0_12 6.461
[email protected] reoon valid 1.1854 yes no thread-pool-0_12 5.744
[email protected] zerobounce valid 1.0279 🏆 yes no thread-pool-0_12 2.930
[email protected] bouncify undeliverable 0.805 no no thread-pool-0_1 181.576
[email protected] captainverify unknown 21.5099 no no thread-pool-0_1 22.836
[email protected] emaillistverify unknown 3.1766 no no thread-pool-0_1 4.208
[email protected] millionverifier invalid 0.4452 no no thread-pool-0_1 1.614
[email protected] myemailverifier invalid 4.0985 no no thread-pool-0_1 6.461
[email protected] reoon invalid 0.7275 no no thread-pool-0_1 5.744
[email protected] zerobounce invalid 0.3171 🏆 no no thread-pool-0_1 2.930
[email protected] bouncify undeliverable 2.0397 no no thread-pool-0_3 181.576
[email protected] captainverify invalid 0.607 no no thread-pool-0_3 22.836
[email protected] emaillistverify email_disabled 1.0901 no no thread-pool-0_3 4.208
[email protected] millionverifier invalid 0.4442 no no thread-pool-0_3 1.614
[email protected] myemailverifier invalid 3.1271 no no thread-pool-0_3 6.461
[email protected] reoon invalid 1.7166 no no thread-pool-0_3 5.744
[email protected] zerobounce invalid 0.3335 🏆 no no thread-pool-0_3 2.930

Email Verification Results Table Compare

Table comparing the JSON field values for each email address across the different Email cleaning service APIs and also compared to local script non-API queries results.

Tested on the same sample emaillist.txt of email addresses. These are their respective returned values for status JSON field which retrieved from the respective API services. While status_code (not used with external APIs), free_email and disposable_email JSON fields are from local script code/databases where applicable. The sub_status is a JSON field only for Zerobounce.

Pay attention to specific email addresses compared for the accuracy of the email verification providers's API results:

Email API status sub_status status_code free_email disposable_email
[email protected] EmailListVerify unknown null null yes yes
[email protected] MillionVerifier disposable null null false yes
[email protected] CaptainVerify risky null null no yes
[email protected] Proofy.io undeliverable null null no yes
[email protected] MyEmailVerifier invalid null null yes yes
[email protected] Zerobounce do_not_mail disposable null yes yes
[email protected] Reoon disposable null null yes yes
[email protected] Bouncify undeliverable null null yes yes
[email protected] Bounceless unknown unknown null yes yes
[email protected] EmailListVerify unknown null null no no
[email protected] MillionVerifier invalid null null false no
[email protected] CaptainVerify invalid null null no no
[email protected] Proofy.io undeliverable null null no no
[email protected] MyEmailVerifier invalid null null no no
[email protected] Zerobounce invalid no_dns_entries null no no
[email protected] Reoon invalid null null no no
[email protected] Bouncify undeliverable null null no no
[email protected] Bounceless no_mx_record no_mx_record null no no
[email protected] EmailListVerify valid null null no no
[email protected] MillionVerifier ok null null false no
[email protected] CaptainVerify valid null null no no
[email protected] Proofy.io deliverable null null no no
[email protected] MyEmailVerifier valid null null no no
[email protected] Zerobounce valid alias_address null no no
[email protected] Reoon valid null null no no
[email protected] Bouncify deliverable null null no no
[email protected] Bounceless Invalid Syntax Syntax Error null no no
[email protected] EmailListVerify email_disabled null null no no
[email protected] MillionVerifier invalid null null false no
[email protected] CaptainVerify invalid null null no no
[email protected] Proofy.io undeliverable null null no no
[email protected] MyEmailVerifier invalid null null no no
[email protected] Zerobounce invalid mailbox_not_found null no no
[email protected] Reoon valid null null no no
[email protected] Bouncify undeliverable null null no no
[email protected] Bounceless unknown unknown null no no
[email protected] EmailListVerify email_disabled null null no no
[email protected] MillionVerifier invalid null null false no
[email protected] CaptainVerify invalid null null no no
[email protected] Proofy.io undeliverable null null no no
[email protected] MyEmailVerifier invalid null null no no
[email protected] Zerobounce invalid mailbox_not_found null no no
[email protected] Reoon valid null null no no
[email protected] Bouncify undeliverable null null no no
[email protected] Bounceless unknown unknown null no no
[email protected] EmailListVerify email_disabled null null no no
[email protected] MillionVerifier invalid null null false no
[email protected] CaptainVerify risky null null no no
[email protected] Proofy.io undeliverable null null no no
[email protected] MyEmailVerifier invalid null null no no
[email protected] Zerobounce invalid mailbox_not_found null no no
[email protected] Reoon valid null null no no
[email protected] Bouncify undeliverable null null no no
[email protected] Bounceless unknown unknown null no no
[email protected] EmailListVerify email_disabled null null no no
[email protected] MillionVerifier invalid null null false no
[email protected] CaptainVerify invalid null null no no
[email protected] Proofy.io undeliverable null null no no
[email protected] MyEmailVerifier invalid null null no no
[email protected] Zerobounce invalid mailbox_not_found null no no
[email protected] Reoon valid null null no no
[email protected] Bouncify undeliverable null null no no
[email protected] Bounceless unknown unknown null no no
[email protected] EmailListVerify email_disabled null null no no
[email protected] MillionVerifier invalid null null false no
[email protected] CaptainVerify invalid null null no no
[email protected] Proofy.io undeliverable null null no no
[email protected] MyEmailVerifier invalid null null no no
[email protected] Zerobounce invalid mailbox_not_found null no no
[email protected] Reoon valid null null no no
[email protected] Bouncify undeliverable null null no no
[email protected] Bounceless unknown unknown null no no
[email protected] EmailListVerify unknown null null no yes
[email protected] MillionVerifier disposable null null false yes
[email protected] CaptainVerify risky null null no yes
[email protected] Proofy.io undeliverable null null no yes
[email protected] MyEmailVerifier invalid null null no yes
[email protected] Zerobounce do_not_mail disposable null no yes
[email protected] Reoon disposable null null yes yes
[email protected] Bouncify undeliverable null null no yes
[email protected] Bounceless invalid invalid null no yes
[email protected] EmailListVerify valid null null no no
[email protected] MillionVerifier ok null null false no
[email protected] CaptainVerify risky null null no no
[email protected] Proofy.io deliverable null null no no
[email protected] MyEmailVerifier valid null null no no
[email protected] Zerobounce do_not_mail role_based null no no
[email protected] Reoon valid null null no no
[email protected] Bouncify deliverable null null no no
[email protected] Bounceless unknown unknown null no no
[email protected] EmailListVerify valid null null yes no
[email protected] MillionVerifier ok null null true no
[email protected] CaptainVerify valid null null yes no
[email protected] Proofy.io deliverable null null yes no
[email protected] MyEmailVerifier valid null null yes no
[email protected] Zerobounce valid null yes no
[email protected] Reoon valid null null yes no
[email protected] Bouncify deliverable null null yes no
[email protected] Bounceless unknown unknown null yes no
[email protected] EmailListVerify email_disabled null null yes no
[email protected] MillionVerifier invalid null null true no
[email protected] CaptainVerify invalid null null yes no
[email protected] Proofy.io undeliverable null null no no
[email protected] MyEmailVerifier invalid null null yes no
[email protected] Zerobounce invalid mailbox_not_found null yes no
[email protected] Reoon valid (quick mode) or invalid (power mode) null null yes no
[email protected] Bouncify undeliverable null null yes no
[email protected] Bounceless unknown unknown null yes no
[email protected] EmailListVerify valid null null yes no
[email protected] MillionVerifier ok (per email API) or unknown (bulk email API) null null true no
[email protected] CaptainVerify unknown null null yes no
[email protected] Proofy.io unknown null null no no
[email protected] MyEmailVerifier valid null null yes no
[email protected] Zerobounce valid null yes no
[email protected] Reoon valid null null yes no
[email protected] Bouncify accept-all null null yes no
[email protected] Bounceless unknown unknown null yes no
[email protected] EmailListVerify valid null null yes no
[email protected] MillionVerifier ok null null true no
[email protected] CaptainVerify valid null null yes no
[email protected] Proofy.io deliverable null null yes no
[email protected] MyEmailVerifier valid null null yes no
[email protected] Zerobounce valid null yes no
[email protected] Reoon valid null null yes no
[email protected] Bouncify deliverable null null yes no
[email protected] Bounceless unknown unknown null yes no
[email protected] EmailListVerify valid null null yes no
[email protected] MillionVerifier ok null null true no
[email protected] CaptainVerify valid null null yes no
[email protected] Proofy.io deliverable null null yes no
[email protected] MyEmailVerifier valid null null yes no
[email protected] Zerobounce valid null yes no
[email protected] Reoon valid null null yes no
[email protected] Bouncify api_error null null yes no
[email protected] Bounceless unknown unknown null yes no

EmailListVerify

First one is EmailListVerify where you set -api emaillistverify -apikey $elvkey where $elvkey is generated API key.

The status field value comes from EmailListVerify API check while free_email and disposable_email field values from from script's own database check. The status_code is null as it's not applicable in -api mode.

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -v
[
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

Where EmailListVerify status codes are as follows:

  • ok All is OK. The server is saying that it is ready to receive a letter to,this address, and no tricks have been detected
  • error The server is saying that delivery failed, but no information about,the email exists
  • smtp_error The SMTP answer from the server is invalid or the destination server,reported an internal error to us
  • smtp_protocol The destination server allowed us to connect but the SMTP,session was closed before the email was verified
  • unknown_email The server said that the delivery failed and that the email address does,not exist
  • attempt_rejected The delivery failed; the reason is similar to “rejected”
  • relay_error The delivery failed because a relaying problem took place
  • antispam_system Some anti-spam technology is blocking the,verification progress
  • email_disabled The email account is suspended, disabled, or limited and can not,receive emails
  • domain_error The email server for the whole domain is not installed or is,incorrect, so no emails are deliverable
  • ok_for_all The email server is saying that it is ready to accept letters,to any email address
  • dead_server The email server is dead, and no connection to it could be established
  • syntax_error There is a syntax error in the email address
  • unknown The email delivery failed, but no reason was given
  • accept_all The server is set to accept all emails at a specific domain.,These domains accept any email you send to them
  • disposable The email is a temporary address to receive letters and expires,after certain time period
  • spamtrap The email address is maintained by an ISP or a third party,which neither clicks nor opens emails
  • invalid_mx An undocumentated status value that isn't in their documentation. As the name implies, invalid MX DNS records

EmailListVerify API integration via -api and apikey arguments combined with Xenforo flags to display the MySQL query to update invalid user's email addresses to email_bounce status in Xenforo database.

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -xf -xfdb xenforo -xfprefix xf_
[
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

Using jq tool to just filter for MySQL queries.

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql) | .xf_sql'
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo

Looks like Emaillistverify might be correct = unknown for status value. So they differentiate disposable emails = unknown I think regardless of whether the email passes SMTP check. Guess that makes sense, so I should also mark disposable emails so they show xf_sql query

Updated local test code as such to mark disposable_email = yes and display xf_sql query.

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -xf -xfdb xenforo -xfprefix xf_
[
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "yes",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "yes",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "yes",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

EmailListVerify Bulk File API

Added support for EmailListVerify Bulk File API upload with added -apibulk emaillistverify argument. Unfortunately for the below number of emails, the bulk API upload took way longer to process at 45 seconds versus 2.2 seconds for per email verification without -apibulk emaillistverify due to remote processing.

cat email_verification_log_2024-05-05_17-03-01.log

2024-05-05 17:03:02,607 - INFO - File MIME type: text/plain
2024-05-05 17:03:02,607 - INFO - Request data: {'filename': 'emaillist_20240505170302.txt'}
2024-05-05 17:03:02,607 - INFO - File data: {'file_contents': ('emaillist_20240505170302.txt', <_io.BufferedReader name='emaillist.txt'>, 'text/plain')}
2024-05-05 17:03:03,293 - INFO - File uploaded successfully. File ID: 2400498
2024-05-05 17:03:03,832 - INFO - File processing in progress. Status: progress
2024-05-05 17:03:09,420 - INFO - File processing in progress. Status: progress
2024-05-05 17:03:14,883 - INFO - File processing in progress. Status: progress
2024-05-05 17:03:20,148 - INFO - File processing in progress. Status: progress
2024-05-05 17:03:25,334 - INFO - File processing in progress. Status: progress
2024-05-05 17:03:30,533 - INFO - File processing in progress. Status: progress
2024-05-05 17:03:35,801 - INFO - File processing in progress. Status: progress
2024-05-05 17:03:41,075 - INFO - File processing in progress. Status: progress
2024-05-05 17:03:46,421 - INFO - File processing completed. Retrieving results from: https://files-elv.s3.eu-central-1.amazonaws.com/2024-05/276e5d9b771214ca9e5e6b59f67b481bfa0a2fabc_all.csv
2024-05-05 17:03:46,783 - INFO - Results file downloaded: emaillistverify_results_1714928583.csv
2024-05-05 17:03:46,784 - INFO - Results retrieved successfully. Total lines: 15

with -apibulk emaillistverify argument

python validate_emails.py -f [email protected] -l emaillist.txt -api emaillistverify -apikey $elvkey -apibulk emaillistverify -tm all
[
    {
        "email": "[email protected]",
        "status": "disposable",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "dead_server",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "disposable",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "no"
    }
]

MillionVerifier

Add MillionVerifier API support

Manual email test via their dashboard reveals

"email","quality","result","free","role"
"[email protected]","bad","disposable","no","yes"
"[email protected]","bad","invalid","no","no"
"[email protected]","good","ok","no","no"
"[email protected]","bad","disposable","no","yes"
"[email protected]","good","ok","no","yes"
"[email protected]","bad","invalid","no","no"
"[email protected]","bad","invalid","no","yes"
"[email protected]","bad","invalid","no","no"
"[email protected]","bad","invalid","no","no"
"[email protected]","bad","invalid","no","no"
"[email protected]","good","ok","yes","no"
"[email protected]","bad","invalid","yes","no"
"[email protected]","good","ok","yes","no"
"[email protected]","good","ok","yes","no"
"[email protected]","good","ok","yes","no"

MillionVerifier API enabled run -api millionverifier -apikey_mv $mvkey

Also updated code to retrive API results for free_email_api and role_api while free_email and disposable_email are local script database lookup based

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey
[
    {
        "email": "[email protected]",
        "status": "disposable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes",
        "free_email_api": false,
        "role_api": true
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": true
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "[email protected]",
        "status": "disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "free_email_api": false,
        "role_api": true
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": true
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    }
]

MillionVerifier API enabled run with -xf -xfdb xenforo -xfprefix xf_ flags

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey -xf -xfdb xenforo -xfprefix xf_
[
    {
        "email": "[email protected]",
        "status": "disposable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes",
        "free_email_api": false,
        "role_api": true,
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false,
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false,
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": true,
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false,
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false,
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false,
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "free_email_api": false,
        "role_api": true,
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": true
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false,
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    }
]

jq filterd for Xenforo MySQL queries only

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql) | .xf_sql'

mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo

MillionVerifier Bulk File API

Added support for MillionVerifier Bulk File API upload with added -apibulk millionverifier argument. Unfortunately for the below number of emails, the bulk API upload took a bit longer to process at 7 seconds versus 2.2 seconds for per email verification without -apibulk millionverifier due to remote processing.

cat email_verification_log_2024-05-06_05-36-30.log

2024-05-06 05:36:31,484 - INFO - Uploading file: emaillist.txt
2024-05-06 05:36:31,484 - INFO - Request URL: https://bulkapi.millionverifier.com/bulkapi/v2/upload?key=APIKEY&remove_duplicates=1
2024-05-06 05:36:31,484 - INFO - Request data: {'key': 'APIKEY'}
2024-05-06 05:36:31,484 - INFO - Request files: {'file_contents': <_io.BufferedReader name='emaillist.txt'>}
2024-05-06 05:36:31,765 - INFO - Response status code: 200
2024-05-06 05:36:31,765 - INFO - Response content: {
    "file_id": "26458323",
    "file_name": "emaillist.txt",
    "status": "unknown",
    "unique_emails": 0,
    "updated_at": "2024-05-06 05:36:31",
    "createdate": "2024-05-06 05:36:31",
    "percent": 0,
    "total_rows": 0,
    "verified": 0,
    "unverified": 0,
    "ok": 0,
    "catch_all": 0,
    "disposable": 0,
    "invalid": 0,
    "unknown": 0,
    "reverify": 0,
    "credit": 0,
    "estimated_time_sec": 0,
    "error": ""
}

2024-05-06 05:36:31,765 - INFO - Response JSON: {'file_id': '26458323', 'file_name': 'emaillist.txt', 'status': 'unknown', 'unique_emails': 0, 'updated_at': '2024-05-06 05:36:31', 'createdate': '2024-05-06 05:36:31', 'percent': 0, 'total_rows': 0, 'verified': 0, 'unverified': 0, 'ok': 0, 'catch_all': 0, 'disposable': 0, 'invalid': 0, 'unknown': 0, 'reverify': 0, 'credit': 0, 'estimated_time_sec': 0, 'error': ''}
2024-05-06 05:36:31,765 - INFO - File uploaded successfully. File ID: 26458323
2024-05-06 05:36:32,046 - INFO - File processing in progress. Progress: 0%
2024-05-06 05:36:37,328 - INFO - File processing completed. Retrieving results.
2024-05-06 05:36:37,607 - INFO - Results file downloaded: millionverifier_results_20240506053637.csv
2024-05-06 05:36:37,608 - INFO - Results retrieved successfully. Total lines: 15

with -apibulk millionverifier argument

Also updated code to retrive API results for free_email_api and role_api while free_email and disposable_email are local script database lookup based

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey -apibulk millionverifier
[
    {
        "email": "[email protected]",
        "status": "disposable",
        "free_email": "yes",
        "disposable_email": "yes",
        "free_email_api": "no",
        "role_api": "yes"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "role_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "role_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "disposable",
        "free_email": "no",
        "disposable_email": "yes",
        "free_email_api": "no",
        "role_api": "yes"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "role_api": "yes"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "role_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "role_api": "yes"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "role_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "role_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "role_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "role_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "role_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "role_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "role_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "role_api": "no"
    }
]

without -apibulk millionverifier argument for per email checks

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey
[
    {
        "email": "[email protected]",
        "status": "disposable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes",
        "free_email_api": false,
        "role_api": true
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": true
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false
    },
    {
        "email": "[email protected]",
        "status": "disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "free_email_api": false,
        "role_api": true
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": true
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    }
]

MillionVerifier Bulk API Differences

Noticed for below sample 15 email addresses tested, I always got 1 refunded credit so it applies to one email address which is a known valid email [email protected] which is classed as unknown in bulk API but classed as ok in per email verification API. They refund credits for emails classified as 'risky' (catch_all or unknown) https://help.millionverifier.com/payments-credits/refund-for-risky-emails. Seems to be a bug in their bulk API then as the refunds only apply to bulk API and not per email verification checks due to differences in classifications in bulk API vs per email verification API.

I reached out to MillionVerifier chat support which was initially handled via Milly their AI chat bot which later referred me to support. They emailed me back saying:

We're glad you reached out to us about this issue, and we're here to help. The discrepancy you're seeing in the results is likely because we were unable to connect to the server during the verification process, leading to an "Unknown" result. However, for the single API, the connection went through smoothly, allowing us to verify the email without any problems. An "Unknown" result simply means that we couldn't determine the existence of the email at the time of verification. If you have any more questions, queries, or issues, we're more than happy to assist.

I tried a few attempts at bulk API for the same list of 15 emails, and [email protected] is always marked as status = unknown and never anything different though? It would be hard to differentiate status classifications if it's due connection issues if they're lumped into other emails in unknown label. Maybe would be better to have a separate classification for connection issues so we can differentiate as such. For example, EmailListVerify has 18 different status classifications including for connection related issues.

single email API check for [email protected] returns ok

python validate_emails.py -f [email protected] -e [email protected] -api millionverifier -apikey_mv $mvkey -tm all
[
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": true,
        "role_api": false
    }
]

bulk API upload check excerpt for [email protected] returns unknown

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey -apibulk millionverifier
[
 
    {
        "email": "[email protected]",
        "status": "unknown",
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "role_api": "no"
    },

]

As such you can't 100% rely on the status output to do tasks like updating Xenforo user's user_state status to stop sending emails to them without further verification for such emails. For now, I've updated my validate_emails.py script for MillionVerifier bulk API and per email check API results, to not list Xenforo SQL queries for unknown status results and only list Xenforo SQL queries for invalid and disposable status emails. Same can be said for other providers, probably need to really double check your results if you're relying on the results for important tasks. You can filter MillionVerifier's unknown status emails and feed them into another commercial provider's API to double check i.e. EmailListVerify or use script's self-hosted local email check. Given cheaper MillionVerifier pricing, it might be more economical to do it this way?

MillionVerifier bulk API filter -api millionverifier -apikey_mv $mvkey -apibulk millionverifier filter using jq for unknown status emails piped into text file results-millionverifier-bulk-api-unknown-only.txt

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api millionverifier -apikey_mv $mvkey -apibulk millionverifier | jq '.[] | select(.status == "unknown")' 2>&1 > results-millionverifier-bulk-api-unknown-only.txt

The results-millionverifier-bulk-api-unknown-only.txt contents will show all MillionVerifier bulk API returned unknown status results.

cat results-millionverifier-bulk-api-unknown-only.txt                                            
{
  "email": "[email protected]",
  "status": "unknown",
  "free_email": "yes",
  "disposable_email": "no",
  "free_email_api": "yes",
  "role_api": "no"
}

Using same results-millionverifier-bulk-api-unknown-only.txt file, and jq just filter out the email addresses into a new results-millionverifier-bulk-api-unknown-only-emails.txt file

cat results-millionverifier-bulk-api-unknown-only.txt | jq -r '.email' | tee results-millionverifier-bulk-api-unknown-only-emails.txt
[email protected]

Then use EmailListVerify bulk API to verify the filtered MillionVerifier unknown status list filtered file results-millionverifier-bulk-api-unknown-only-emails.txt and double check the status which confirms it's actually a valid email.

python validate_emails.py -f [email protected] -l results-millionverifier-bulk-api-unknown-only-emails.txt -tm all -api emaillistverify -apikey $elvkey -apibulk emaillistverify

[
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "no"
    }
]

Or EmailListVerify per email verification API check

./validate_emails.py -f [email protected] -e [email protected] -tm all -api emaillistverify -apikey $elvkey -tm all
[
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

Or if it's a few emails, via validate_emails.py script's self-hosted local email syntax, DNS and SMTP check

  validate_emails.py -f [email protected] -e [email protected] -tm all
[
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

CaptainVerify API

Add CaptainVerify API support.

CaptainVerify's API has rate limits, as such script needed to add such to it's routines.

The API is limited to a maximum of 2 simultaneous connections and 50 checks per minute. When integrating the API, make sure your application does not exceed this limit.

update_captainverify_rate_limit Function

The update_captainverify_rate_limit function is responsible for managing the rate limiting of requests to the CaptainVerify API. It ensures that the script complies with the API's rate limits of a maximum of 2 simultaneous connections and 50 checks per minute.

Purpose

The purpose of the update_captainverify_rate_limit function is to coordinate access to the CaptainVerify API across multiple processes and prevent exceeding the API's rate limits. It achieves this by using a shared file (captainverify_rate_limit.json) to store and update the rate limiting information.

Functionality

The update_captainverify_rate_limit function performs the following steps:

  1. It takes a lock_file parameter, which specifies the path to the file used for storing the rate limiting information.
  2. It opens the lock_file in read and write mode ('r+') to allow reading from and writing to the file.
  3. It acquires an exclusive lock on the file using the fcntl.flock function with the fcntl.LOCK_EX flag. This ensures that only one process can access and modify the file at a time, preventing race conditions.
  4. It reads the existing rate limiting data from the file using json.load. The rate limiting data includes the timestamp of the last request (last_request_time) and the count of requests made within the current minute (request_count).
  5. It calculates the elapsed time since the last request by subtracting last_request_time from the current time.
  6. If the elapsed time is less than 60 seconds (indicating that the current minute has not passed), it increments the request_count by 1.
  7. If the request_count exceeds 50 (the maximum allowed requests per minute), it calculates the remaining time until the current minute completes and sleeps for that duration using time.sleep. After sleeping, it updates last_request_time to the current time and resets request_count to 1.
  8. If the elapsed time is greater than or equal to 60 seconds (indicating that a new minute has started), it updates last_request_time to the current time and resets request_count to 1.
  9. It updates the last_request_time and request_count values in the data dictionary.
  10. It seeks to the beginning of the file using file.seek(0), writes the updated data dictionary to the file using json.dump, and truncates any remaining content in the file using file.truncate(). This ensures that the file contains only the updated rate limiting data.
  11. It releases the exclusive lock on the file using fcntl.flock with the fcntl.LOCK_UN flag, allowing other processes to access the file.

Usage

The update_captainverify_rate_limit function is called within the validate_and_classify function whenever an email verification request is made to the CaptainVerify API (i.e., when args.api == 'captainverify' and args.test_mode == 'all').

By calling update_captainverify_rate_limit before making the API request, the script ensures that the rate limiting information is updated and that the API's rate limits are respected across multiple processes.

The lock_file parameter specifies the path to the file used for storing the rate limiting information. In the provided code, the file is named 'captainverify_rate_limit.json' and is initialized in the main function.

Manual email test via their dashboard reveals

email;status;free;disposable;role;ok_for_all;protected;did_you_mean;details
[email protected];risky;0;1;1;1;0;;low quality
[email protected];invalid;0;0;0;0;0;;smtp error
[email protected];ok;0;0;0;0;0;;
[email protected];risky;0;1;1;1;0;;low quality
[email protected];risky;0;0;1;0;0;;low quality
[email protected];invalid;0;0;0;0;0;;email error
[email protected];invalid;0;0;1;0;0;;email error
[email protected];invalid;0;0;1;0;0;;email error
[email protected];invalid;0;0;0;0;0;;email error
[email protected];invalid;0;0;0;0;0;;email error
[email protected];ok;1;0;0;0;0;;
[email protected];invalid;1;0;0;0;0;;email error
[email protected];unknown;1;0;0;0;0;;
[email protected];ok;1;0;0;0;0;;
[email protected];ok;1;0;0;0;0;;

CaptainVerify API enabled run -api captainverify -apikey_cv $cvkey

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api captainverify -apikey_cv $cvkey -xf -xfdb xenforo -xfprefix xf_
[
    {
        "email": "[email protected]",
        "status": "risky",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "risky",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "risky",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "risky",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

jq filterd for Xenforo MySQL queries only

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api captainverify -apikey_cv $cvkey -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql) | .xf_sql'
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo

Proofy API

Add Proofy.io API support

Proofy.io API enabled run -api proofy -apikey_pf $pkey -apiuser_pf $puser

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api proofy -apikey_pf $pkey -apiuser_pf $puser -xf -xfdb xenforo -xfprefix xf_
[
    {
        "email": "[email protected]",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "deliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "deliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "deliverable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo"
    },
    {
        "email": "[email protected]",
        "status": "deliverable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "deliverable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

Unfortunately, Proofy.io has a stricter max concurrent connection limit so will slow down processing of email verifications. Proofy.io API limits mean email verifications are at least 2x or more slower. As such need to add a -pf_max_connections parameter which set to 1 by default when argument not passed on command line like above. But even with -pf_max_connections 2 Proofy.io API complains and email status = api_error occur.

From email_verification_log_2024-05-05_14-06-36.log

2024-05-05 14:07:08,450 - ERROR - Unexpected API response for [email protected]: {'error': True, 'message': 'You already use the maximum number of simultaneous connections. Try this request later.'}
2024-05-05 14:07:08,450 - ERROR - Max retries exceeded for [email protected]. Skipping

Testing Proofy.io, ran out of credits from log email_verification_log_2024-05-05_14-20-50.log

2024-05-05 14:21:35,810 - ERROR - Unexpected API response for [email protected]: {'error': True, 'message': "You don't have checks. Check your balance."}
2024-05-05 14:21:46,461 - ERROR - Max retries exceeded for [email protected]. Skipping.
python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api proofy -apikey_pf $pkey -apiuser_pf $puser -xf -xfdb xenforo -xfprefix xf_ -pf_max_connections 2
[
    {
        "email": "[email protected]",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "[email protected]",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "[email protected]",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "[email protected]",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "[email protected]",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "[email protected]",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "[email protected]",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "[email protected]",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "[email protected]",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "[email protected]",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "[email protected]",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "[email protected]",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "[email protected]",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "[email protected]",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    },
    {
        "email": "[email protected]",
        "status": "api_error",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "unknown"
    }
]

jq filterd for Xenforo MySQL queries only

python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api proofy -apikey_pf $pkey -apiuser_pf $puser -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql) | .xf_sql'
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo

MyEmailVerifier API

Add MyEmailVerifier API support

MyEmailVerifier API enabled run -api myemailverifier -apikey_mev $mevkey

python validate_emails.py -f [email protected] -l emaillist.txt -api myemailverifier -apikey_mev $mevkey -tm all
[
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

jq filterd for Xenforo MySQL queries only

python validate_emails.py -f [email protected] -l emaillist.txt -api myemailverifier -apikey_mev $mevkey -tm all -xf -xfdb xenforo -xfprefix xf_ | jq -r '.[] | select(.xf_sql) | .xf_sql'

mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo
mysql -e "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';" xenforo

Zerobounce API

Add Zerobounce API support

Zerobounce API enabled run -api zerobounce -apikey_zb $zbkey -tm all with specified email address -e [email protected]. The status, sub_status and free_email_api JSON fields are from API and free_email and disposable_email JSON fields are from local script database checks.

python validate_emails.py -f [email protected] -e [email protected] -tm all -api zerobounce -apikey_zb $zbkey

[
    {
        "email": "[email protected]",
        "status": "invalid",
        "sub_status": "no_dns_entries",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no"
    }
]

For email per verification API check for list of emails in emaillist.txt via -l emaillist.txt. The status, sub_status and free_email_api JSON fields are from API and free_email and disposable_email JSON fields are from local script database checks.

time python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api zerobounce -apikey_zb $zbkey
[
    {
        "email": "[email protected]",
        "status": "do_not_mail",
        "sub_status": "disposable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes",
        "free_email_api": "yes"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "sub_status": "no_dns_entries",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "sub_status": "alias_address",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "sub_status": "mailbox_not_found",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "sub_status": "mailbox_not_found",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "sub_status": "mailbox_not_found",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "sub_status": "mailbox_not_found",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "sub_status": "mailbox_not_found",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "do_not_mail",
        "sub_status": "disposable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "free_email_api": "yes"
    },
    {
        "email": "[email protected]",
        "status": "do_not_mail",
        "sub_status": "role_based",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "sub_status": "",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "sub_status": "mailbox_not_found",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "sub_status": "",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "sub_status": "",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "sub_status": "",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes"
    }
]

real    0m4.794s
user    0m2.218s
sys     0m0.065s

Test ZeroBounce per email check API -api zerobounce -apikey_zb $zbkey with Cloudflare Cache -apicache zerobounce -apicachettl 900

time python validate_emails.py -f [email protected] -e [email protected] -tm all -api zerobounce -apikey_zb $zbkey -tm all -apicache zerobounce -apicachettl 900

[
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    }
]

real    0m0.777s
user    0m0.253s
sys     0m0.034s

Log inspection

cat $(ls -Art | tail -3 | grep 'email_verification')

2024-05-11 11:28:05,131 - INFO - Cache result: {'address': '[email protected]', 'status': 'invalid', 'sub_status': 'no_dns_entries', 'free_email': False, 'did_you_mean': None, 'account': 'hnyfmw', 'domain': 'canadlan-drugs.com', 'domain_age_days': '2026', 'smtp_provider': '', 'mx_found': 'false', 'mx_record': '', 'firstname': None, 'lastname': None, 'gender': None, 'country': None, 'region': None, 'city': None, 'zipcode': None, 'processed_at': '2024-05-11 10:37:39.035'}

Cloudflare KV storage entries

Key Value
zerobounce:[email protected] {"result":{"address":"[email protected]","status":"invalid","sub_status":"no_dns_entries","free_email":false,"did_you_mean":null,"account":"hnyfmw","domain":"canadlan-drugs.com","domain_age_days":"2026","smtp_provider":"","mx_found":"false","mx_record":"","firstname":null,"lastname":null,"gender":null,"country":null,"region":null,"city":null,"zipcode":null,"processed_at":"2024-05-11 11:39:24.133"},"timestamp":1715427564270,"ttl":900}

Test Cloudflare R2 storage via -store r2 to save email verification results to Cloudflare R2 bucket directory at emailapi-zerobounce-cached/output_20240511122039.json

time python validate_emails.py -f [email protected] -e [email protected] -tm all -api zerobounce -apikey_zb $zbkey -tm all -apicache zerobounce -apicachettl 900 -store r2

Output stored successfully in R2: emailapi-zerobounce-cached/output_20240511122039.json
[
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    }
]

real    0m1.210s
user    0m0.355s
sys     0m0.031s

Reoon API

Add Reoon API support

Reoon API enabled run -api reoon -apikey_rn $reokey -tm all with specified email address -e [email protected]. The status, role_account, mx_accepts_mail, spamtrap, mx_records, overall_score, safe_to_send, can_connect_smtp, inbox_full, catch_all, deliverable, disabled JSON field is from API and free_email and disposable_email JSON fields are from local script database checks.

Reoon has 2 modes for single email verification API which can be set via -reoon_mode to a value of either quick or power. The default mode without -reoon_mode being set is quick.

time python validate_emails.py -f [email protected] -e [email protected] -tm all -api reoon -apikey_rn $reokey

[
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "role_account": "no",
        "mx_accepts_mail": "no",
        "spamtrap": "no",
        "mx_records": null,
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    }
]

real    0m3.748s
user    0m0.358s
sys     0m0.028s

With -reoon_mode power. Currently, script hasn't been configured to grab the additional information provided by power mode.

time python validate_emails.py -f [email protected] -e [email protected] -tm all -api reoon -apikey_rn $reokey -reoon_mode power

[
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "role_account": "no",
        "mx_accepts_mail": "no",
        "spamtrap": "no",
        "mx_records": [],
        "verification_mode": "power",
        "overall_score": 0,
        "safe_to_send": "no",
        "can_connect_smtp": "no",
        "inbox_full": "no",
        "catch_all": "no",
        "deliverable": "no",
        "disabled": "no"
    }
]

real    0m3.196s
user    0m0.360s
sys     0m0.026s

For email per verification API check for list of emails in emaillist.txt via -l emaillist.txt. The status JSON field is from API and free_email and disposable_email JSON fields are from local script database checks.

time python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api reoon -apikey_rn $reokey

[
    {
        "email": "[email protected]",
        "status": "disposable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes",
        "role_account": "yes",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "in.mailsac.com",
            "alt.mailsac.com"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "role_account": "no",
        "mx_accepts_mail": "no",
        "spamtrap": "no",
        "mx_records": null,
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "role_account": "no",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "aspmx.l.google.com",
            "alt1.aspmx.l.google.com",
            "alt2.aspmx.l.google.com",
            "aspmx2.googlemail.com",
            "aspmx4.googlemail.com",
            "aspmx3.googlemail.com",
            "aspmx5.googlemail.com"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "role_account": "no",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "aspmx.l.google.com",
            "alt1.aspmx.l.google.com",
            "alt2.aspmx.l.google.com",
            "aspmx2.googlemail.com",
            "aspmx4.googlemail.com",
            "aspmx3.googlemail.com",
            "aspmx5.googlemail.com"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "role_account": "yes",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "aspmx.l.google.com",
            "alt1.aspmx.l.google.com",
            "alt2.aspmx.l.google.com",
            "aspmx2.googlemail.com",
            "aspmx4.googlemail.com",
            "aspmx3.googlemail.com",
            "aspmx5.googlemail.com"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "role_account": "yes",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "aspmx.l.google.com",
            "alt1.aspmx.l.google.com",
            "alt2.aspmx.l.google.com",
            "aspmx2.googlemail.com",
            "aspmx4.googlemail.com",
            "aspmx3.googlemail.com",
            "aspmx5.googlemail.com"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "role_account": "no",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "aspmx.l.google.com",
            "alt1.aspmx.l.google.com",
            "alt2.aspmx.l.google.com",
            "aspmx2.googlemail.com",
            "aspmx4.googlemail.com",
            "aspmx3.googlemail.com",
            "aspmx5.googlemail.com"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "role_account": "no",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "aspmx.l.google.com",
            "alt1.aspmx.l.google.com",
            "alt2.aspmx.l.google.com",
            "aspmx2.googlemail.com",
            "aspmx4.googlemail.com",
            "aspmx3.googlemail.com",
            "aspmx5.googlemail.com"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "[email protected]",
        "status": "disposable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes",
        "role_account": "yes",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "mx.discard.email"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "role_account": "yes",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "aspmx.l.google.com",
            "alt2.aspmx.l.google.com",
            "alt1.aspmx.l.google.com",
            "aspmx2.googlemail.com",
            "aspmx5.googlemail.com",
            "aspmx3.googlemail.com",
            "aspmx4.googlemail.com"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "role_account": "no",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "gmail-smtp-in.l.google.com",
            "alt1.gmail-smtp-in.l.google.com",
            "alt2.gmail-smtp-in.l.google.com",
            "alt3.gmail-smtp-in.l.google.com",
            "alt4.gmail-smtp-in.l.google.com"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "role_account": "no",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "gmail-smtp-in.l.google.com",
            "alt1.gmail-smtp-in.l.google.com",
            "alt2.gmail-smtp-in.l.google.com",
            "alt3.gmail-smtp-in.l.google.com",
            "alt4.gmail-smtp-in.l.google.com"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "role_account": "no",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "mta7.am0.yahoodns.net",
            "mta5.am0.yahoodns.net",
            "mta6.am0.yahoodns.net"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "role_account": "no",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "outlook-com.olc.protection.outlook.com"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "role_account": "no",
        "mx_accepts_mail": "yes",
        "spamtrap": "no",
        "mx_records": [
            "hotmail-com.olc.protection.outlook.com"
        ],
        "verification_mode": "quick",
        "overall_score": null,
        "safe_to_send": null,
        "can_connect_smtp": null,
        "inbox_full": null,
        "catch_all": null,
        "deliverable": null,
        "disabled": null
    }
]

real    0m2.176s
user    0m2.350s
sys     0m0.050s

Bouncify API

Add Bouncify API support

Bouncify API enabled run -api bouncify -apikey_bf $bfkey -tm all with specified email address -e [email protected]. The status, free_email_api, disposable_email_api, role_api, and spamtrap_api JSON field are from API and free_email and disposable_email JSON fields are from local script database checks.

time python validate_emails.py -f [email protected] -e [email protected] -tm all -api bouncify -apikey_bf $bfkey
[
    {
        "email": "[email protected]",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    }
]

real    0m7.900s
user    0m0.357s
sys     0m0.030s

For email per verification API check for list of emails in emaillist.txt via -l emaillist.txt. The status, free_email_api, disposable_email_api, role_api, and spamtrap_api JSON field are from API and free_email and disposable_email JSON fields are from local script database checks.

Seems to be the slowest API processing time email verification providers tested to date and had a API issues. The diagnostic log shows that Bouncify API marked incorrectly that the [email protected] email address as an accept-all email address and validation for [email protected] email address timed out. Their API docs at https://bouncify.readme.io/reference/single-validation-api, suggest a 120 concurrent request API limit and that Apart from undeliverable, for the results deliverable, accept-all and unknown do not reject the email address and proceed with your work flow. Both accept-all and unknown emails could not be validated, so they may be valid email address.

2024-05-12 12:44:44,519 - ERROR - Unexpected API response for [email protected]: {'result': 'Validation timedout', 'success': False}
time python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api bouncify -apikey_bf $bfkey
[
    {
        "email": "[email protected]",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes",
        "free_email_api": "yes",
        "disposable_email_api": "yes",
        "role_api": "yes",
        "spamtrap_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "deliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "free_email_api": "no",
        "disposable_email_api": "yes",
        "role_api": "yes",
        "spamtrap_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "deliverable",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "yes",
        "spamtrap_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "deliverable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "undeliverable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "accept-all",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "deliverable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    },
    {
        "email": "[email protected]",
        "status": "api_error",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    }
]

real    3m4.412s
user    0m2.366s
sys     0m0.049s

Re-trying the Hotmail [email protected] re-tried individually worked without timeouts

time python validate_emails.py -f [email protected] -e [email protected] -tm all -api bouncify -apikey_bf $bfkey
[
    {
        "email": "[email protected]",
        "status": "deliverable",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "no",
        "spamtrap_api": "no"
    }
]

real    0m3.516s
user    0m0.362s
sys     0m0.025s

Bounceless API

Add Bounceless API support

Bounceless API enabled run -api bounceless -apikey_bl $blkey -tm all with specified email address -e [email protected]. The status, reason, free_email_api, disposable_email_api, role_api and accept_all JSON fields are from API and free_email and disposable_email JSON fields are from local script database checks.

This returned a correct status result of no_mx_record as expected, but the 15 email address sample test further below was highly inaccurate for known valid email addresses as you can see.

time python validate_emails.py -f [email protected] -e [email protected] -tm all -api bounceless -apikey_bl $blkey

[
    {
        "email": "[email protected]",
        "status": "no_mx_record",
        "reason": "no_mx_record",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "no",
        "accept_all": "no"
    }
]

real    0m2.582s
user    0m0.395s
sys     0m0.022s

For email per verification API check for list of emails in emaillist.txt via -l emaillist.txt. The status, reason, free_email_api, disposable_email_api, role_api and accept_all JSON fields are from API and free_email and disposable_email JSON fields are from local script database checks.

Unfortunately, this has to be the worse email verification result I have received for my sample 15 email addresses compared to all other commercial email verification providers. All the known valid emails are marked as unknown - not 1 valid email address below was marked correctly as valid! I double checked on their web dashboard inputting single known valid email addresses and they return the same incorrect status as below API results gave.

time python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api bounceless -apikey_bl $blkey
[
    {
        "email": "[email protected]",
        "status": "unknown",
        "reason": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    },
    {
        "email": "[email protected]",
        "status": "no_mx_record",
        "reason": "no_mx_record",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "no",
        "disposable_email_api": "no",
        "role_api": "no",
        "accept_all": "no"
    },
    {
        "email": "[email protected]",
        "status": "Invalid Syntax",
        "reason": "Syntax Error",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "reason": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "reason": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "reason": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "reason": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "reason": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "reason": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes",
        "free_email_api": "no",
        "disposable_email_api": "yes",
        "role_api": "no",
        "accept_all": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "reason": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "reason": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "reason": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "reason": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "reason": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "reason": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no",
        "free_email_api": "yes",
        "disposable_email_api": "no",
        "role_api": "yes",
        "accept_all": "no"
    }
]

real    0m22.085s
user    0m2.354s
sys     0m0.061s

To confirm and verify, I tested Bounceless's API directly and same result for known valid email address [email protected] which returns a result of unknown! Also API response time was very slow for single email verification result at 15.825s and for above 15 email address samples was 22.085s.

time curl -s "https://apps.bounceless.io/api/singlemaildetails?secret=$blkey&[email protected]" | jq -r

{
  "success": true,
  "accept_all": false,
  "result": "unknown",
  "reason": "unknown",
  "role": true,
  "free": true,
  "disposable": false,
  "user": "",
  "domain": "",
  "email": "[email protected]",
  "did_you_mean": null,
  "message": ""
}

real    0m15.825s
user    0m0.028s
sys     0m0.004s

After 1/2 day, I tried retesting Bounceless API against known valid Gmail address, and it seems it fluctuates between a result status of unknown and valid between runs. Maybe it's due to some security mechanisms on Gmail's server end but other commercial provider's APIs have always returned correctly for this known valid Gmail address. Note though the slower API result times >12-15 seconds remain.

time curl -s "https://apps.bounceless.io/api/singlemaildetails?secret=$blkey&[email protected]" | jq -r
{
  "success": true,
  "accept_all": false,
  "result": "valid",
  "reason": "valid",
  "role": false,
  "free": true,
  "disposable": false,
  "user": "user",
  "domain": "gmail.com",
  "email": "[email protected]",
  "did_you_mean": null,
  "message": ""
}

real    0m12.500s
user    0m0.029s
sys     0m0.004s

API Merge

Added support for -apimerge argument which allows you to merge Merging EmailListVerify + MillionVerifier API results together for more accurate email verification results.

The table below shows how long it took to execute and process the verification checks using validate_emails.py and merged APIs. Looks like subsequent runs were faster due to probably primed caches at respective providers' backends.

API Merge Command Processing Time
Per Email Verification 15.946 seconds
Bulk API File Upload 47.536 seconds
Per Email Verification with Xenforo 10.666 seconds
Bulk API File Upload with Xenforo 41.260 seconds

Merging EmailListVerify + MillionVerifier API results for both into one JSON result output for per email verification checks

time python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -api millionverifier -apikey_mv $mvkey -apimerge
[
    {
        "email": "[email protected]",
        "elv_status": "disposable",
        "elv_status_code": null,
        "elv_free_email": "yes",
        "elv_disposable_email": "yes",
        "mv_status": "disposable",
        "mv_status_code": null,
        "mv_free_email": "yes",
        "mv_disposable_email": "yes",
        "mv_free_email_api": false,
        "mv_role_api": true
    },
    {
        "email": "[email protected]",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": false
    },
    {
        "email": "[email protected]",
        "elv_status": "ok",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": false
    },
    {
        "email": "[email protected]",
        "elv_status": "disposable",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "yes",
        "mv_status": "disposable",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "yes",
        "mv_free_email_api": false,
        "mv_role_api": true
    },
    {
        "email": "[email protected]",
        "elv_status": "ok",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": true
    },
    {
        "email": "[email protected]",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": false
    },
    {
        "email": "[email protected]",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": true
    },
    {
        "email": "[email protected]",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": false
    },
    {
        "email": "[email protected]",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": false
    },
    {
        "email": "[email protected]",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": false
    },
    {
        "email": "[email protected]",
        "elv_status": "ok",
        "elv_status_code": null,
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_status_code": null,
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": true,
        "mv_role_api": false
    },
    {
        "email": "[email protected]",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": true,
        "mv_role_api": false
    },
    {
        "email": "[email protected]",
        "elv_status": "ok",
        "elv_status_code": null,
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_status_code": null,
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": true,
        "mv_role_api": false
    },
    {
        "email": "[email protected]",
        "elv_status": "ok",
        "elv_status_code": null,
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_status_code": null,
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": true,
        "mv_role_api": false
    },
    {
        "email": "[email protected]",
        "elv_status": "ok",
        "elv_status_code": null,
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_status_code": null,
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": true,
        "mv_role_api": false
    }
]

real    0m15.946s
user    0m1.017s
sys     0m0.037s

Merging EmailListVerify + MillionVerifier API results for both into one JSON result output for bulk API file upload checks -apibulk

time python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -apibulk emaillistverify -api millionverifier -apikey_mv $mvkey -apibulk millionverifier -apimerge

[
    {
        "email": "[email protected]",
        "elv_status": "disposable",
        "elv_status_code": "",
        "elv_free_email": "yes",
        "elv_disposable_email": "yes",
        "mv_status": "disposable",
        "mv_free_email": "yes",
        "mv_disposable_email": "yes",
        "mv_free_email_api": "no",
        "mv_role_api": "yes"
    },
    {
        "email": "[email protected]",
        "elv_status": "dead_server",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "no"
    },
    {
        "email": "[email protected]",
        "elv_status": "valid",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "no"
    },
    {
        "email": "[email protected]",
        "elv_status": "disposable",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "yes",
        "mv_status": "disposable",
        "mv_free_email": "no",
        "mv_disposable_email": "yes",
        "mv_free_email_api": "no",
        "mv_role_api": "yes"
    },
    {
        "email": "[email protected]",
        "elv_status": "valid",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "yes"
    },
    {
        "email": "[email protected]",
        "elv_status": "email_disabled",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "no"
    },
    {
        "email": "[email protected]",
        "elv_status": "email_disabled",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "yes"
    },
    {
        "email": "[email protected]",
        "elv_status": "email_disabled",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "no"
    },
    {
        "email": "[email protected]",
        "elv_status": "email_disabled",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "no"
    },
    {
        "email": "[email protected]",
        "elv_status": "email_disabled",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "no"
    },
    {
        "email": "[email protected]",
        "elv_status": "valid",
        "elv_status_code": "",
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": "yes",
        "mv_role_api": "no"
    },
    {
        "email": "[email protected]",
        "elv_status": "email_disabled",
        "elv_status_code": "",
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": "yes",
        "mv_role_api": "no"
    },
    {
        "email": "[email protected]",
        "elv_status": "valid",
        "elv_status_code": "",
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "unknown",
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": "yes",
        "mv_role_api": "no"
    },
    {
        "email": "[email protected]",
        "elv_status": "valid",
        "elv_status_code": "",
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": "yes",
        "mv_role_api": "no"
    },
    {
        "email": "[email protected]",
        "elv_status": "valid",
        "elv_status_code": "",
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": "yes",
        "mv_role_api": "no"
    }
]

real    0m47.536s
user    0m0.612s
sys     0m0.021s

Merging EmailListVerify + MillionVerifier API results for both into one JSON result output for per email verification checks + Xenforo flags

time python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -api millionverifier -apikey_mv $mvkey -apimerge -xf -xfdb xenforo -xfprefix xf_

[
    {
        "email": "[email protected]",
        "elv_status": "disposable",
        "elv_status_code": null,
        "elv_free_email": "yes",
        "elv_disposable_email": "yes",
        "mv_status": "disposable",
        "mv_status_code": null,
        "mv_free_email": "yes",
        "mv_disposable_email": "yes",
        "mv_free_email_api": false,
        "mv_role_api": true,
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": false,
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "elv_status": "ok",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": false
    },
    {
        "email": "[email protected]",
        "elv_status": "disposable",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "yes",
        "mv_status": "disposable",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "yes",
        "mv_free_email_api": false,
        "mv_role_api": true,
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "elv_status": "ok",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": true
    },
    {
        "email": "[email protected]",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": false,
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": true,
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": false,
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": false,
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": false,
        "mv_role_api": false,
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "elv_status": "ok",
        "elv_status_code": null,
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_status_code": null,
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": true,
        "mv_role_api": false
    },
    {
        "email": "[email protected]",
        "elv_status": "invalid",
        "elv_status_code": null,
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_status_code": null,
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": true,
        "mv_role_api": false,
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "elv_status": "ok",
        "elv_status_code": null,
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_status_code": null,
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": true,
        "mv_role_api": false
    },
    {
        "email": "[email protected]",
        "elv_status": "ok",
        "elv_status_code": null,
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_status_code": null,
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": true,
        "mv_role_api": false
    },
    {
        "email": "[email protected]",
        "elv_status": "ok",
        "elv_status_code": null,
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_status_code": null,
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": true,
        "mv_role_api": false
    }
]

real    0m10.666s
user    0m1.008s
sys     0m0.034s

Merging EmailListVerify + MillionVerifier API results for both into one JSON result output for bulk API file upload checks -apibulk + Xenforo flags

time python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -apibulk emaillistverify -api millionverifier -apikey_mv $mvkey -apibulk millionverifier -apimerge -xf -xfdb xenforo -xfprefix xf_

[
    {
        "email": "[email protected]",
        "elv_status": "disposable",
        "elv_status_code": "",
        "elv_free_email": "yes",
        "elv_disposable_email": "yes",
        "mv_status": "disposable",
        "mv_free_email": "yes",
        "mv_disposable_email": "yes",
        "mv_free_email_api": "no",
        "mv_role_api": "yes",
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "elv_status": "dead_server",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "no",
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "elv_status": "valid",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "no"
    },
    {
        "email": "[email protected]",
        "elv_status": "disposable",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "yes",
        "mv_status": "disposable",
        "mv_free_email": "no",
        "mv_disposable_email": "yes",
        "mv_free_email_api": "no",
        "mv_role_api": "yes",
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "elv_status": "valid",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "yes"
    },
    {
        "email": "[email protected]",
        "elv_status": "email_disabled",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "no",
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "elv_status": "email_disabled",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "yes",
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "elv_status": "email_disabled",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "no",
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "elv_status": "email_disabled",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "no",
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "elv_status": "email_disabled",
        "elv_status_code": "",
        "elv_free_email": "no",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "no",
        "mv_disposable_email": "no",
        "mv_free_email_api": "no",
        "mv_role_api": "no",
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "elv_status": "valid",
        "elv_status_code": "",
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": "yes",
        "mv_role_api": "no"
    },
    {
        "email": "[email protected]",
        "elv_status": "email_disabled",
        "elv_status_code": "",
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "invalid",
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": "yes",
        "mv_role_api": "no",
        "elv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "elv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "elv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo",
        "mv_xf_sql": "mysql -e \"UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';\" xenforo",
        "mv_xf_sql_batch": "UPDATE xf_user SET user_state = 'email_bounce' WHERE email = '[email protected]';",
        "mv_xf_sql_user": "mysql -e \"SELECT user_id, username, email, user_group_id, secondary_group_ids, message_count, register_date, last_activity, user_state, is_moderator, is_admin, is_banned FROM xf_user WHERE email = '[email protected]'\\G\" xenforo"
    },
    {
        "email": "[email protected]",
        "elv_status": "valid",
        "elv_status_code": "",
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": "yes",
        "mv_role_api": "no"
    },
    {
        "email": "[email protected]",
        "elv_status": "valid",
        "elv_status_code": "",
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": "yes",
        "mv_role_api": "no"
    },
    {
        "email": "[email protected]",
        "elv_status": "valid",
        "elv_status_code": "",
        "elv_free_email": "yes",
        "elv_disposable_email": "no",
        "mv_status": "ok",
        "mv_free_email": "yes",
        "mv_disposable_email": "no",
        "mv_free_email_api": "yes",
        "mv_role_api": "no"
    }
]

real    0m41.260s
user    0m0.581s
sys     0m0.033s

API Merge Filters

For API merged results, if you ran the commands and piped them into a results.txt file, you can then query and filter them using jq tool for different combinations of elv_status and mv_status values as follows:

  1. Find good emails, filter good emails where elv_status is "valid" and mv_status is "ok":
cat results.txt | jq '.[] | select(.elv_status == "valid" and .mv_status == "ok")'
cat results.txt | jq '.[] | select(.elv_status == "valid" and .mv_status == "ok")'
{
  "email": "[email protected]",
  "elv_status": "valid",
  "elv_status_code": "",
  "elv_free_email": "no",
  "elv_disposable_email": "no",
  "mv_status": "ok",
  "mv_free_email": "no",
  "mv_disposable_email": "no",
  "mv_free_email_api": "no",
  "mv_role_api": "no"
}
{
  "email": "[email protected]",
  "elv_status": "valid",
  "elv_status_code": "",
  "elv_free_email": "no",
  "elv_disposable_email": "no",
  "mv_status": "ok",
  "mv_free_email": "no",
  "mv_disposable_email": "no",
  "mv_free_email_api": "no",
  "mv_role_api": "yes"
}
{
  "email": "[email protected]",
  "elv_status": "valid",
  "elv_status_code": "",
  "elv_free_email": "yes",
  "elv_disposable_email": "no",
  "mv_status": "ok",
  "mv_free_email": "yes",
  "mv_disposable_email": "no",
  "mv_free_email_api": "yes",
  "mv_role_api": "no"
}
{
  "email": "[email protected]",
  "elv_status": "valid",
  "elv_status_code": "",
  "elv_free_email": "yes",
  "elv_disposable_email": "no",
  "mv_status": "ok",
  "mv_free_email": "yes",
  "mv_disposable_email": "no",
  "mv_free_email_api": "yes",
  "mv_role_api": "no"
}
{
  "email": "[email protected]",
  "elv_status": "valid",
  "elv_status_code": "",
  "elv_free_email": "yes",
  "elv_disposable_email": "no",
  "mv_status": "ok",
  "mv_free_email": "yes",
  "mv_disposable_email": "no",
  "mv_free_email_api": "yes",
  "mv_role_api": "no"
}
  1. Find bad emails, filter emails where elv_status is "invalid" and mv_status is "invalid":
cat results.txt | jq '.[] | select(.elv_status == "invalid" and .mv_status == "invalid")'
  1. Filter emails where elv_status is "valid" but mv_status is not "ok":

This filters for if you ran MillionVerifier bulk API and there is a bug in unknown status, you can use EmailListVerify API to double check it's status.

cat results.txt | jq '.[] | select(.elv_status == "valid" and .mv_status != "ok")'
cat results.txt | jq '.[] | select(.elv_status == "valid" and .mv_status != "ok")'
{
  "email": "[email protected]",
  "elv_status": "valid",
  "elv_status_code": "",
  "elv_free_email": "yes",
  "elv_disposable_email": "no",
  "mv_status": "unknown",
  "mv_free_email": "yes",
  "mv_disposable_email": "no",
  "mv_free_email_api": "yes",
  "mv_role_api": "no"
}
  1. Filter emails where elv_status is not "valid" but mv_status is "ok":

This would be the reverse of previous check, to double check EmailListVerify's result against MillionVerifier

cat results.txt | jq '.[] | select(.elv_status != "valid" and .mv_status == "ok")'
  1. Filter bad emails where elv_status is not "valid" and mv_status is not "ok":
cat results.txt | jq '.[] | select(.elv_status != "valid" and .mv_status != "ok")'
  1. Filter emails where elv_status is "disposable" and mv_status is "disposable":
cat results.txt | jq '.[] | select(.elv_status == "disposable" and .mv_status == "disposable")'
  1. Filter emails where elv_status is "unknown" and mv_status is "unknown":
cat results.txt | jq '.[] | select(.elv_status == "unknown" and .mv_status == "unknown")'
  1. Filter emails where either elv_status or mv_status is "invalid":
cat results.txt | jq '.[] | select(.elv_status == "invalid" or .mv_status == "invalid")'
  1. Filter emails where either elv_status or mv_status is "disposable":
cat results.txt | jq '.[] | select(.elv_status == "disposable" or .mv_status == "disposable")'
  1. Filter emails where either elv_status or mv_status is "unknown":
cat results.txt | jq '.[] | select(.elv_status == "unknown" or .mv_status == "unknown")'
  1. Filter emails where elv_status is "valid" and mv_status is "unknown":

This filters for if you ran MillionVerifier bulk API and there is a bug in unknown status, you can use EmailListVerify API to double check it's status.

cat results.txt | jq '.[] | select(.elv_status == "valid" and .mv_status == "unknown")'
cat results.txt | jq '.[] | select(.elv_status == "valid" and .mv_status == "unknown")'
{
  "email": "[email protected]",
  "elv_status": "valid",
  "elv_status_code": "",
  "elv_free_email": "yes",
  "elv_disposable_email": "no",
  "mv_status": "unknown",
  "mv_free_email": "yes",
  "mv_disposable_email": "no",
  "mv_free_email_api": "yes",
  "mv_role_api": "no"
}

These jq queries cover various combinations of elv_status and mv_status values, allowing you to filter the results.txt file based on different criteria. You can adjust the specific status values in the queries according to your needs and the available status values in the results.txt file.

Remember to replace results.txt with the actual path to your file if it's located in a different directory.

Cloudflare HTTP Forward Proxy Cache With KV Storage

validate_emails.py script's EmailListVerify, MillionVerifier and Zerobounce per email check API routines has been updated to support a custom Cloudflare HTTP forward proxy Worker cache configuration which can take the script's API request and forward it to EmailListVerify's API endpoint. The Cloudflare Worker script will then save the API result into Cloudflare KV storage on their edge servers and save with a date timestamp. This can potentially reduce your overall EmailListVerify per email verification costs if you need to run validate_emails.py a few times back to back bypassing having to need to call validate_emails.py API itself.

validate_emails.py script added -apicache, -apicachettl, -apicache-purge and -apicachecheck arguments:

  • -apicache this sets the Cloudflare Worker's cacheKey and allows extending caching to other API providers in future. For now supported value are emaillistverify and zerobounce which will end up creating the cacheKey in Worker const cacheKey = ${apiCache}:${email}; for lookups etc.
  • -apicachecheck takes count or list or purge option to query the Cloudflare KV storage cache to count number of cached entries or list the entries themselves or purge Cloudflare CDN/KV stores in cache.
  • -apicache-purge will purge Cloudflare CDN/KV cache when -apicachecheck set to purge options to query the
  • -apicachettl this sets the cache TTL duration in seconds for how long Cloudflare CDN/KV stores in cache. Default value is 300s or 5mins

One usage case for this would be if you verify a list of 1,000 email addresses and in a short amount of time (i.e. 24hrs) have an additional 500 email addresses added to the email list to total 1,500 emails. Then if you had originally verified the list with -apicache and -apicachettl 172800 parameters, and did a second verification run, the original 1,000 email addresses would of already been stored in Cloudflare CDN and/or Cloudflare Worker KV storage caching so would not result in an API request/costs. Leaving only the 500 new email addresses resulting in an API request/costs. However, you would get a full JSON formatted result output for all 1,500 email addresses - ready for further processing/manipulation etc. Of course, you can also just have 2 separate verification runs for 1,000 emails and then for 500 emails and have 2 separate JSON formatted result outputs to work with which you can combine etc.

Another usage case is in case of email duplication in your lists. If you have the email address referenced multiple times in an email list, then using -apicache and -apicachettl 172800 parameters like parameters for first verification run, would allow it process and detect duplicates on second run via the Cloudflare CDN / Worker KV cached return results rather than make needless duplicate API request calls which would cost money. A lot of email verification providers offer email list deduplication as a built in feature while others offer it for additional costs. But with Cloudflare CDN / Worker KV caching in place, you wouldn't need to worry about the email verification provider's support for email deduplication. Thus saving your money $$$$$!

Examples to illustrate how the Cloudflare HTTP forward proxy caching KV worker workers for testing email address [email protected]

Via direct EmailListVerify API call returns email address status = unknown

curl -s "https://apps.emaillistverify.com/api/verifyEmail?secret=$elvkey&[email protected]&timeout=15"
unknown

Uncached usual run via the script usual result response would be unknown

time python validate_emails.py -f [email protected] -e [email protected] -tm all -api emaillistverify -apikey $elvkey
[
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "no"
    }
]

real    0m2.600s
user    0m0.279s
sys     0m0.020s

Via Cloudflare HTTP forward proxy caching KV worker with -apicachettl 120 argument set returns email address status = unknown reducing time to return the result from 2.6s to 0.397s

time python validate_emails.py -f [email protected] -e [email protected] -tm all -api emaillistverify -apikey $elvkey -apicache emaillistverify -apicachettl 120
[
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "no"
    }
]

real    0m0.397s
user    0m0.294s
sys     0m0.025s

Log inspection

cat email_verification_log_2024-05-08_15-08-05.log | tail -3
2024-05-08 15:08:06,816 - INFO - Checking cache for email: [email protected]
2024-05-08 15:08:07,047 - INFO - Cache check response status code: 200
2024-05-08 15:08:07,047 - INFO - Cache result: unknown

Testing Cloudflare HTTP forward proxy caching KV worker directly

curl -s "https://cfcachedomain.com/[email protected]&cachettl=120"
unknown

Cloudflare HTTP forward proxy caching KV worker console logged

[DEBUG] Incoming request: https://cfcachedomain.com/[email protected]&cachettl=120
[DEBUG] Email: [email protected]
[DEBUG] Cache Key: emaillistverify:[email protected]
[DEBUG] Cache TTL: 120
[DEBUG] Cache Check: null
[DEBUG] API URL: https://apps.emaillistverify.com/api/verifyEmail?secret=APIKEY&[email protected]&timeout=15
[DEBUG] Response from Cloudflare CDN cache: Hit
[DEBUG] Skipping KV cache update as response is served from Cloudflare CDN cache
[DEBUG] Returning final response with headers: {"cache-control":"max-age=120","content-type":"text/plain"}

Check how many KV storage cached email result entries there are

curl -s "https://cfcachedomain.com/?apicachecheck=count" | jq -r
{
  "count": 1
}

Query the actual KV storage cached email address entries including the cache age

curl -s "https://cfcachedomain.com/?apicachecheck=list" | jq -r
[
  {
    "email": "[email protected]",
    "result": "unknown",
    "timestamp": 1715175271549,
    "age": 16,
    "ttl": 120
  }
]

Query the KV storage cache entries count via -apicachecheck count

time python validate_emails.py -f [email protected] -e [email protected] -tm all -api emaillistverify -apikey $elvkey -apicache emaillistverify -apicachettl 120 -apicachecheck count

API cache count: 1

Query the KV storage cache entries listings via -apicachecheck list

time python validate_emails.py -f [email protected] -e [email protected] -tm all -api emaillistverify -apikey $elvkey -apicache emaillistverify -apicachettl 120 -apicachecheck list

API cache list:
{'email': '[email protected]', 'result': 'unknown', 'timestamp': 1715175271549, 'age': 16, 'ttl': 120}

Cloudflare KV storage entries

Key Value
emaillistverify:[email protected] {"result":"unknown","timestamp":1715175271549,"ttl":120}

MillionVerifier Cloudflare Cache Support

May 17, 2023 added MillionVerifier Cloudflare cache support.

For MillionVerifier per email check API -api millionverifier -apikey_mv $mvkey with Cloudflare Cache -apicache millionverifier -apicachettl 120. Added api_response_time and api_thread_number JSON fields which measure the response time from Cloudflare Worker KV cached storage/store or Cloudflare CDN cache.

Note: updated MillionVerifier API JSON response to also report API returned subresult value.

time python validate_emails.py -f [email protected] -e [email protected] -tm all -api millionverifier -apikey_mv $mvkey -apicache millionverifier -apicachettl 120
[
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "api_response_time": 0.0001,
        "api_thread_number": "cached",
        "free_email_api": "no",
        "role_api": "no",
        "subresult": "dns_error"
    }
]

real    0m0.776s
user    0m0.271s
sys     0m0.021s

Compared with uncached regular API response where MillionVerifier's API api_response_time = 0.2962 seconds compared to Cloudflare cached api_response_time = 0.001 seconds. While validate_emails.py script time difference was 0.776s cached vs 1.631s uncached.

time python validate_emails.py -f [email protected] -e [email protected] -tm all -api millionverifier -apikey_mv $mvkey
[
    {
        "email": "[email protected]",
        "status": "invalid",
        "subresult": "dns_error",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "free_email_api": false,
        "role_api": false,
        "api_response_time": 0.2962,
        "api_thread_number": "thread-pool-0_0"
    }
]

real    0m1.631s
user    0m0.356s
sys     0m0.025s

ZeroBounce Cloudflare Cache Support

For ZeroBounce per email check API -api zerobounce -apikey_zb $zbkey with Cloudflare Cache -apicache zerobounce -apicachettl 900

time python validate_emails.py -f [email protected] -e [email protected] -api zerobounce -apikey_zb $zbkey -tm all -apicache zerobounce -apicachettl 900
[
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no",
        "api_response_time": 0.0,
        "api_thread_number": "cached"
    }
]

real    0m0.784s
user    0m0.260s
sys     0m0.027s

Log inspection

cat logs/$(ls -Art logs | tail -3 | grep 'email_verification')                                       
2024-05-17 00:19:14,801 - INFO - Making cache check request to: https://cfworkerdomain.com?email=hnyfmw%40canadlan-drugs.com&cachettl=900&apicache=zerobounce
2024-05-17 00:19:14,986 - INFO - Cache result: {'address': '[email protected]', 'status': 'invalid', 'sub_status': 'no_dns_entries', 'free_email': False, 'did_you_mean': None, 'account': 'hnyfmw', 'domain': 'canadlan-drugs.com', 'domain_age_days': '2032', 'smtp_provider': '', 'mx_found': 'false', 'mx_record': '', 'firstname': None, 'lastname': None, 'gender': None, 'country': None, 'region': None, 'city': None, 'zipcode': None, 'processed_at': '2024-05-17 00:08:48.644'}

Compared to regular non-cached ZeroBounce API request with api_response_time = 0.159 seconds using api_thread_number thread pool = 0_0. While validate_emails.py script time difference was 0.784s cached vs 4.501s uncached.

time python validate_emails.py -f [email protected] -e [email protected] -tm all -api zerobounce -apikey_zb $zbkey
[
    [
        {
            "email": "[email protected]",
            "status": "invalid",
            "sub_status": "no_dns_entries",
            "status_code": null,
            "free_email": "no",
            "disposable_email": "no",
            "free_email_api": "no",
            "api_response_time": 0.158,
            "api_thread_number": "thread-pool-0_0"
        }
    ]
]

real    0m4.501s
user    0m0.353s
sys     0m0.027s

Cloudflare Cache Purge Support

Add support to purge Cloudflare KV storage via -apicache-purge -apicachecheck purge when combined with -apicache emaillistverify

python validate_emails.py -f [email protected] -l emaillist.txt -apicache-purge -apicache emaillistverify -apicachecheck purge

Cache purged successfully

Run with -apicachecheck count to report the number of cached entries in Cloudflare KV storage after cache purge:

python validate_emails.py -f [email protected] -l emaillist.txt -apicache-purge -apicache emaillistverify -apicachecheck count

API cache count: {'bulk_count': 0, 'email_count': 0}

EmailListVeirfy Bulk File API Cloudflare Cache Support

Add Cloudflare cache support to EmailListVerify's bulk file API routine via -apicache emaillistverify -apicachettl 120 and ran it 3 times - for unprimed cache and primed cached run for 2nd and 3rd runs to compare time to completion. Cloudflare HTTP forward proxy KV cache Worker reduced times from 40.771s to 2.078s.

Run Compeletion Time
1st Bulk File API Run uncached 40.771s
2nd Bulk File API Run cached 2.292s
3rd Bulk File API Run cached 2.078s

Example 1st EmailListVerify bulk API unprimed Cloudflare Worker cache run timed:

time python validate_emails.py -f [email protected] -l emaillist.txt -api emaillistverify -apikey $elvkey -apibulk emaillistverify -apicache emaillistverify -apicachettl 120 -tm all
[
    {
        "email": "[email protected]",
        "status": "disposable",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "dead_server",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "disposable",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": "",
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "valid",
        "status_code": "",
        "free_email": "yes",
        "disposable_email": "no"
    }
]

real    0m40.771s
user    0m0.469s
sys     0m0.019s

Inspecting logs

cat $(ls -Art | tail -3 | grep 'email_verification')                                             
2024-05-10 09:59:28,893 - INFO - File MIME type: text/plain
2024-05-10 09:59:29,050 - INFO - Request data: {'filename': 'emaillist_20240510095928.txt'}
2024-05-10 09:59:29,050 - INFO - File data: {'file_contents': ('emaillist_20240510095928.txt', <_io.BufferedReader name='emaillist.txt'>, 'text/plain')}
2024-05-10 09:59:30,258 - INFO - File uploaded successfully. File ID: 2408431
2024-05-10 09:59:30,538 - INFO - File processing in progress. Status: progress
2024-05-10 09:59:36,056 - INFO - File processing in progress. Status: progress
2024-05-10 09:59:41,604 - INFO - File processing in progress. Status: progress
2024-05-10 09:59:47,171 - INFO - File processing in progress. Status: progress
2024-05-10 09:59:52,687 - INFO - File processing in progress. Status: progress
2024-05-10 09:59:57,959 - INFO - File processing in progress. Status: progress
2024-05-10 10:00:03,519 - INFO - File processing in progress. Status: progress
2024-05-10 10:00:08,927 - INFO - File processing completed. Retrieving results from: https://files-elv.s3.eu-central-1.amazonaws.com/2024-05/5b1ab4d47750dd66625245e1a0645328f93e8abc_all.csv
2024-05-10 10:00:09,259 - INFO - Results file downloaded: emaillistverify_results_1715335169.csv
2024-05-10 10:00:09,456 - INFO - Bulk file results cached in Cloudflare
2024-05-10 10:00:09,456 - INFO - Results retrieved successfully. Total lines: 15

Example 2nd EmailListVerify bulk API primed Cloudflare Worker cache run timed:

time python validate_emails.py -f [email protected] -l emaillist.txt -api emaillistverify -apikey $elvkey -apibulk emaillistverify -apicache emaillistverify -apicachettl 120 -tm all
[
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "invalid_syntax",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

real    0m2.292s
user    0m0.533s
sys     0m0.022s

Log inspection shows bulk file API upload process was skipped as all email addresses in bulk file -l emaillist.txt passed on command line were found in Cloudflare cache.

cat $(ls -Art | tail -3 | grep 'email_verification')                                             
2024-05-10 10:34:03,308 - INFO - File MIME type: text/plain
2024-05-10 10:34:05,392 - INFO - All email results found in cache. Skipping file upload.

Example 3rd EmailListVerify bulk API primed Cloudflare Worker cache run timed:

time python validate_emails.py -f [email protected] -l emaillist.txt -api emaillistverify -apikey $elvkey -apibulk emaillistverify -apicache emaillistverify -apicachettl 120 -tm all
[
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "invalid_syntax",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

real    0m2.078s
user    0m0.527s
sys     0m0.038s

Log inspection shows bulk file API upload process was skipped as all email addresses in bulk file -l emaillist.txt passed on command line were found in Cloudflare cache.

cat $(ls -Art | tail -3 | grep 'email_verification')                                             
2024-05-10 10:34:10,862 - INFO - File MIME type: text/plain
2024-05-10 10:34:12,724 - INFO - All email results found in cache. Skipping file upload.

EmailListVerify API Check Times: Regular vs Cached

This table presents a side-by-side comparison of the time taken for regular and cached EmailListVerify API checks. Testing Cloudflare HTTP Forward Proxy Cache With KV Storage with EmailListVerify per email check API. Ran the same 15 emails emaillist.txt test and timed the 3 runs each.

First cached email verification checks are slower due to priming the cache overhead. While subseqent cached runs were much faster compared to uncached regular email verification checks.

Run Regular Time Cached Time
1st Run 5.102s 5.437s
2nd Run 3.146s 1.029s
3rd Run 3.248s 0.944s

Regular uncached run 1

time python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey
[
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

real    0m5.102s
user    0m0.299s
sys     0m0.026s

Regular uncached run 2

time python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey
[
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

real    0m3.146s
user    0m0.303s
sys     0m0.022s

Regular uncached run 3

time python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey
[
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "invalid",
        "status_code": null,
        "free_email": "unknown",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown_email",
        "status_code": 550,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": 250,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

real    0m3.248s
user    0m0.296s
sys     0m0.030s

Cached run 1

time python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -apicache emaillistverify -apicachettl 120
[
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "invalid_syntax",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

real    0m5.437s
user    0m2.339s
sys     0m0.044s

Cached run 2

time python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -apicache emaillistverify -apicachettl 120
[
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "invalid_syntax",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

real    0m1.029s
user    0m2.373s
sys     0m0.043s

Cached run 3

time python validate_emails.py -f [email protected] -l emaillist.txt -tm all -api emaillistverify -apikey $elvkey -apicache emaillistverify -apicachettl 120
[
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "invalid_syntax",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "unknown",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "yes"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "no",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "email_disabled",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    },
    {
        "email": "[email protected]",
        "status": "ok",
        "status_code": null,
        "free_email": "yes",
        "disposable_email": "no"
    }
]

real    0m0.944s
user    0m2.316s
sys     0m0.050s

PHP Wrapper

Created a simplistic PHP wrapper script to call validate_emails.py from that can test multiple email verification API providers as well as local non-API tests for a single inputted email address. The PHP wrapper will also time how long it takes to return an email verification check's JSON response. This was tested on a PHP 8.3.6 based Centmin Mod LEMP stack server.

Provider Completion Time
Local (Non-API) 0.516784s
EmailListVerify 2.96s
MillionVerifier 0.84s
CaptainVerify 21.96s
Proofy.io 31.77s (API error, ran out of credits)
MyEmailVerifier 3.09s
Zerobounce 0.68s
Reoon 0.72s
Bouncify 1.04s

First one is local non-API test = 0.516784s

Email verification PHP Wrapper script

EmailListVerify = 2.96s

Email verification PHP Wrapper script

MillionVerifier = 0.84s

Email verification PHP Wrapper script

CaptainVerify = 21.96s

Email verification PHP Wrapper script

Proofy.io = 31.77s for api_error ran out of credits right now

Email verification PHP Wrapper script

MyEmailVerifier = 3.09s

Email verification PHP Wrapper script

Zerobounce = 0.68s

Email verification PHP Wrapper script

Reoon = 0.72s

Email verification PHP Wrapper script

Bouncify = 1.04s

Email verification PHP Wrapper script

PHP Wrapper With Cloudflare Cache And S3 Store Support

Updated PHP wrapper script with single and multiple email support via validate_emails.py per email verification routines and added validate_emails.py supported Cloudflare Cache (enabled for EmailListVerify and Zerobounce) and also support for S3 storage to store email verification results to either Amazon AWS S3 or Cloudflare R2 object storage buckets.

Note: Timings reported include time for S3 storage - in this case saving to Cloudflare R2 bucket

Single email address EmailListVerify runs including a debug run

Email verification PHP Wrapper script with Cloudflare Cache & S3 storage support

Email verification PHP Wrapper script with Cloudflare Cache & S3 storage support

Email verification PHP Wrapper script with Cloudflare Cache & S3 storage support

Multiple email addresses EmailListVerify runs including a debug run

Email verification PHP Wrapper script with Cloudflare Cache & S3 storage support

Email verification PHP Wrapper script with Cloudflare Cache & S3 storage support

Email verification PHP Wrapper script with Cloudflare Cache & S3 storage support

About

Self-hosted email verification script to clean up bad invalid email address lists. Supports various commercial email verification provider APIs all in one script

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published