How to NOT update ALL config.yml files, if a token expires?

[gitttt54]

Hi,
I have about 20 collection files, which use trakt/plex/tmdb api/tokens/etc.

Everytime, the Trakt or Plex token expires, I need to manually change a lot of *.yml files by hand to set the new valid tokens.
like this:

| plex:                                                                                              |
|   url: (redacted)                                                                                  |
|   token: (redacted)                                                                                |
| tautulli:                                                                                          |
|   url: (redacted)                                                                                  |
|   apikey: (redacted)                                                                               |
| tmdb:                                                                                              |
|   apikey: (redacted)                                                                               |
| trakt:                                                                                             |
|   client_id: (redacted)                                                                            |
|   client_secret: (redacted)                                                                        |
|   authorization:                                                                                   |
|     access_token: (redacted)                                                                       |
|     token_type: Bearer                                                                             |
|     expires_in: 7889238                                                                            |
|     refresh_token: (redacted)                                                                      |
|     scope: public                                                                                  |
|     created_at: 1721438061                                                                         |
|   pin:                                                                                             |
|       

That is very cumbersome and also complicated.

So I wondered, if there is a more userfriendly way to acually put the credentials into a single file and let all other config yml files read those credentials from it.

I tried a token.yml

tokens:
  plex_url: &plex_url "https://123:32400"
  plex_token: &plex_token foo
  plex_timeout: &plex_timeout 120
  plex_clean_bundles: &plex_clean_bundles false
  plex_empty_trash: &plex_empty_trash false
  plex_optimize: &plex_optimize false
  plex_db_cache: &plex_db_cache
  plex_verify_ssl: &plex_verify_ssl

  tautulli_url: &tautulli_url "http://123:8181"
  tautulli_apikey: &tautulli_apikey 123

  tmdb_apikey: &tmdb_apikey 123
  tmdb_language: &tmdb_language de
  tmdb_cache_expiration: &tmdb_cache_expiration 60
  tmdb_region: &tmdb_region

  trakt_client_id: &trakt_client_id 123
  trakt_client_secret: &trakt_client_secret 123
  trakt_access_token: &trakt_access_token 123
  trakt_token_type: &trakt_token_type Bearer
  trakt_expires_in: &trakt_expires_in 7889238
  trakt_refresh_token: &trakt_refresh_token 123
  trakt_scope: &trakt_scope public
  trakt_created_at: &trakt_created_at 1720126501
  trakt_pin: &trakt_pin

and import it to the config:

imports:
  - tokens.yml

plex:
  url: *plex_url
  token: *plex_token
  timeout: *plex_timeout
  clean_bundles: *plex_clean_bundles
  empty_trash: *plex_empty_trash
  optimize: *plex_optimize
  db_cache: *plex_db_cache
  verify_ssl: *plex_verify_ssl

tautulli:
  url: *tautulli_url
  apikey: *tautulli_apikey

tmdb:
  apikey: *tmdb_apikey
  language: *tmdb_language
  cache_expiration: *tmdb_cache_expiration
  region: *tmdb_region

trakt:
  client_id: *trakt_client_id
  client_secret: *trakt_client_secret
  authorization:
    access_token: *trakt_access_token
    token_type: *trakt_token_type
    expires_in: *trakt_expires_in
    refresh_token: *trakt_refresh_token
    scope: *trakt_scope
    created_at: *trakt_created_at
  pin: *trakt_pin

but that did not work as hoped ;-)

I've searched the net, but no help arrived...

So I'd like to ask here, if there is *any* userfriendly way to not have all config yml files updated by hand if a token expires?

Thank you.

[chazlarson]

Config secrets

[gitttt54]

Thank you! That worked nicely!

Although, when I had put PLEX_TOKEN=1234 in my .env file, it did not work and throwed an execption, while all other variables did work fine. I renamed the variable to MY_PLEX_TOKEN and then it worked too. Must be a collision with the variablename...dunno, THANKS again!

[gitttt54]

regarding to this:

Although, when I had put PLEX_TOKEN=1234 in my .env file, it did not work and throwed an execption, while all other variables did work fine. I renamed the variable to MY_PLEX_TOKEN and then it worked too. Must be a collision with the variablename...dunno,

that whole .env thing seems kinda buggy to me.
when I enter MY_PLEX_TOKEN in the .env file, the MY_PLEX_TOKEN is not mentioned in the log as all others, say:

Kometa Secrets Read: |
| --kometa-my-tmdb-api-key (KOMETA_MY_TMDB_API_KEY): (redacted) |
| --kometa-my-trakt-client-id (KOMETA_MY_TRAKT_CLIENT_ID): (redacted) |
| --kometa-my-trakt-client-secret (KOMETA_MY_TRAKT_CLIENT_SECRET): (redacted) |
| --kometa-my-trakt-access-token (KOMETA_MY_TRAKT_ACCESS_TOKEN): (redacted) |
| --kometa-my-trakt-token-type (KOMETA_MY_TRAKT_TOKEN_TYPE): (redacted) |
| --kometa-my-trakt-expires-in (KOMETA_MY_TRAKT_EXPIRES_IN): (redacted) |
| --kometa-my-trakt-refresh-token (KOMETA_MY_TRAKT_REFRESH_TOKEN): (redacted) |
| --kometa-my-trakt-scope (KOMETA_MY_TRAKT_SCOPE): (redacted) |
| --kometa-my-trakt-created-at (KOMETA_MY_TRAKT_CREATED_AT): (redacted) |
| --kometa-my-trakt-pin (KOMETA_MY_TRAKT_PIN): (redacted) |

its just ignored...
it seems to me, IF the line contains the word PLEX it leads to problems and kometa does not use the plex token at all.

when I rename it to something other, NOT containing the word PLEX, the log show the correct entries AND kometa uses the token as expected.

| --kometa-my-plux-token (KOMETA_MY_PLUX_TOKEN): (redacted)

just wanted to mention....

[gitttt54]

also, the first line of the .env file is ignores by kometa. I had my KOMETA_MY_TAUTULLI_API_KEY=12345 completely ignored, so I put a comment ####### in the first line of the .env file and it showed up in the log and was'nt ignored anymore.

[gitttt54]

unfortunately...that did only work nicely until I needed to enter a new trakt pin.

I have tried this way (putting my new PIN to the .env file)

trakt:
  client_id: <<MY_TRAKT_CLIENT_ID>
  client_secret: <<MY_TRAKT_CLIENT_SECRET>>
  authorization:
    access_token: 4289ea789443545413ebcb474df47fda609510f4682c69
    token_type: Bearer
    expires_in: 7889238
    refresh_token: 85915476cf4c967953456546e638e19f1ca1f0ef677dc14daa52b11fa57
    scope: public
    created_at: 1721438061
  pin: <<MY_TRAKT_PIN>>

or putting all to the .env file:

trakt:
  client_id: <<MY_TRAKT_CLIENT_ID>
  client_secret: <<MY_TRAKT_CLIENT_SECRET>>
  authorization:
    access_token: <<MY_TRAKT_ACCESS_TOKEN>>
    token_type: <<MY_TRAKT_TOKEN_TYPE>>
    expires_in: <<MY_TRAKT_EXPIRES_IN>>
    refresh_token: <<MY_TRAKT_REFRESH_TOKEN>>
    scope: <<MY_TRAKT_SCOPE>>
    created_at: <<MY_TRAKT_CREATED_AT>>
  pin:

but none of any variant did work out to create a new working trakt auth.

I got logs like these:

| Connecting to Trakt...                                                                             |
| Trakt Error: (403) Forbidden                                                                       |
| Refreshing Access Token...                                                                         |
| Navigate to: https://trakt.tv/oauth/authorize?response_type=code&redirect_uri=urn:ietf:wg:oauth:2.0:oob&client_id=<<MY_TRAKT_CLIENT_ID> |
| If you get an OAuth error your client_id or client_secret is invalid                               |
| Trakt pin (case insensitive): | Input Failed                                                                                       |
| Trakt Connection Failed

Would anyone please tell me HOW one can update the trakt auth while using the .env file?

I did not find any helpful example anywhere.

[chazlarson]

My first question is why you need to reauthenticate trakt so often with a new pin. I authenticated trakt months ago and have never had to refresh it manually or enter a new pin.

[gitttt54]

My first question is why you need to reauthenticate trakt so often with a new pin. I authenticated trakt months ago and have never had to refresh it manually or enter a new pin.

I have no idea why. Maybe because it is an free/unpaid trakt account?

For me, its almost 2-3 months, I guess.

How can I get info about "why"?

[gitttt54]

As I don't know why and how things don't work with secrets and .env and why threre is so much hassle on my side,
I let chatgpt write me a script to copy the new trakt auth from https://github.com/Kometa-Team/Trakt-MAL-OAuth to my several configs.
At least, I don't have to update all my configs by hand now.

"""
This script (please name it: copy_new_trakt_auth.py) updates YAML files in the current directory
by replacing specific values based on the content of a 'copy_new_trakt_auth.yml' file,
which should be copy&pasted via https://github.com/Kometa-Team/Trakt-MAL-OAuth
Backups of the original files are created before any changes are made.

Requirements:
- Python 3.x
- ruamel.yaml library (Install with: pip install ruamel.yaml)

How it works:
1. The script loads new key-value pairs from 'copy_new_trakt_auth.yml'.
2. It then scans the current directory for all YAML files (files ending in .yml or .yaml).
3. For each YAML file found (excluding 'copy_new_trakt_auth.yml'), it replaces values based on the keys found in 'copy_new_trakt_auth.yml'.
4. If changes are made, a backup of the original file is created in the format 'filename.timestamp.bak'.
5. The script outputs whether a file was updated or if no changes were necessary.
"""

import os
from ruamel.yaml import YAML  # Install with: pip install ruamel.yaml
import shutil
from datetime import datetime

# Initialize the YAML handler from ruamel.yaml
yaml = YAML()
yaml.preserve_quotes = True  # Preserve any quotes around values

# Variable to hold the name of the new values file
new_values_file = 'copy_new_trakt_auth.yml'

# Function to create a backup of the original YAML file
def create_backup(file_path):
    timestamp = datetime.now().strftime('%Y%m%d%H%M%S')
    backup_file_path = f"{file_path}.{timestamp}.bak"
    shutil.copy(file_path, backup_file_path)
    print(f"Backup created: {backup_file_path}")

# Function to load the replacement values from 'copy_new_trakt_auth.yml'
def load_new_values():
    try:
        with open(new_values_file, 'r') as file:
            return yaml.load(file)
    except FileNotFoundError:
        print(f"Error: '{new_values_file}' file not found. Please ensure the file is in the current directory.")
        exit(1)
    except Exception as e:
        print(f"Error loading '{new_values_file}': {e}")
        exit(1)

# Function to update a given YAML file with the replacement values
def update_yaml_file(file_path, replacement_values):
    try:
        with open(file_path, 'r') as file:
            data = yaml.load(file)
    except Exception as e:
        print(f"Error reading {file_path}: {e}")
        return

    replaced_keys = 0

    # Recursive function to replace values in the YAML structure
    def replace_values(data, replacements):
        nonlocal replaced_keys
        if isinstance(data, dict) and isinstance(replacements, dict):
            for key, value in replacements.items():
                if key in data:
                    if isinstance(value, dict):
                        replace_values(data[key], value)
                    else:
                        if data[key] != value:
                            data[key] = value
                            replaced_keys += 1

    # Perform the value replacement
    replace_values(data, replacement_values)

    # If any replacements were made, create a backup and save the updated file
    if replaced_keys > 0:
        create_backup(file_path)

        try:
            with open(file_path, 'w') as file:
                yaml.dump(data, file)
            print(f"File updated: {file_path} – {replaced_keys} keys replaced.")
        except Exception as e:
            print(f"Error writing to {file_path}: {e}")
    else:
        print(f"No changes required in {file_path}.")

# Main function that orchestrates the file updates
def main():
    # Load the replacement values from 'copy_new_trakt_auth.yml'
    replacement_values = load_new_values()

    # Flag to check if any YAML files are found
    yaml_files_found = False

    # Iterate over all files in the current directory
    for filename in os.listdir('.'):
        if filename.endswith('.yml') or filename.endswith('.yaml'):
            if filename != new_values_file:  # Skip the 'copy_new_trakt_auth.yml' file itself
                yaml_files_found = True
                update_yaml_file(filename, replacement_values)

    # If no YAML files were found, print a message
    if not yaml_files_found:
        print("No YAML files found in the current directory.")

# Entry point of the script
if __name__ == "__main__":
    main()