Hello,
I wonder how to define missing values in the IODA converter? In the below python code,
#!/usr/bin/env python3
# read airnow data and convert to netcdf
import netCDF4 as nc
import numpy as np
import inspect, os, sys, argparse
import pandas as pd
from datetime import datetime
from pathlib import Path
IODA_CONV_PATH = Path(__file__).parent/"@SCRIPT_LIB_PATH@"
if not IODA_CONV_PATH.is_dir():
IODA_CONV_PATH = Path(__file__).parent/'..'/'lib-python'
sys.path.append(str(IODA_CONV_PATH.resolve()))
import meteo_utils
import ioda_conv_ncio as iconv
from collections import defaultdict, OrderedDict
from orddicts import DefaultOrderedDict
def read_monitor_file(sitefile=None):
show original
missing values are filled in like this
outdata[varDict[‘pm25_tot’][‘valKey’]] = np.array(f3[‘PM2.5’].fillna(nc.default_fillvals[‘f4’]))
Is this a standard way of defining missing values in JEDI?
Thanks.
Hi Bo, yes this is a standard way of defining missing values. The ioda reader queries the variable for its fill value and data values that match the variable’s fill value will be replaced with the internal JEDI missing value (of which the filters, QC, etc. recognize).