$HJj6! dZddlZddlZddlmZmZerddlmZdZdZ de e efde e effd Z d e d e d e de e effd Z dZdZGddZy)a Functionality to convert tabular data in Frictionless Data Packages to CSVW. We translate [table schemas](https://specs.frictionlessdata.io/table-schema/) defined for [data resources](https://specs.frictionlessdata.io/data-resource/) in a [data package](https://specs.frictionlessdata.io/data-package/) to a CVSW TableGroup. This functionality can be used together with the `frictionless describe` command to add CSVW metadata to "raw" CSV tables. N)Any TYPE_CHECKING) TableGroupcddi}ddk(rjdrd|d<ddk(r8jdr'jdrdd d dd |d<dd vr[jd d ur tdtfddDr)i|d<dD]}j|s||d|<!|S)Nbasetypestringformat dc:formatboolean trueValues falseValuesr|)numberinteger bareNumberTzbareNumber is not supported in CSVW. It may be possible to translate to a number pattern, though. See https://www.w3.org/TR/2015/REC-tabular-data-model-20151217/#formats-for-numeric-typesc3&K|]}|v ywN).0propspecs [/Users/ahmed/devFolder/claude-voice/.venv/lib/python3.12/site-packages/csvw/frictionless.py z,_convert_numeric_datatype.. sE(Dtt|(Ds) decimalChar groupChar)getNotImplementedErrorany)rdatatypeps` r_convert_numeric_datatyper"sV %H F|xDHHX$6 $X F|y TXXl%;@W $\ 21 56a]8KA8N7OP F|,, 88L !T )%-. . E(DE E!#HX 188A;,0GHX&q)2 Ocddd}d|vr||ddk(r|jddk(rddiS|ddk(r|jdd k(rdd iS|d|vr d||diS|dd vr t|S|dd vrd ddS|ddk(rd ddSddiS)NgYear gYearMonth)year yearmonthrr r binaryrurianyURI)r rrr datetimedatetimeduration)objectarrayjsonzapplication/json)rr geojsonzapplication/geo+json)rr")rtypemaps r_convert_datatyper5(s!G~ <8 #(:h(FH% % <8 #(:e(CH% % <7 "GDL12 2 <  -T2 2 <. ."1CD D <9 $"1GH H H r#rreturnc6|dt|d}|jdfDcgc]}|s| }}|r||d<d|vr |dg|d<d|vr|d|d<|jd i}d D])}||vr |||d |<d |vsd |d vs|d |d d <+|Scc}w)zj https://specs.frictionlessdata.io/table-schema/#field-descriptors :param spec: :return: name)r8r titletitles descriptiondc:descriptionrdfType propertyUrl constraints)required minLength maxLengthminimummaximumr patternr )r5r)rrestr:r?rs rconvert_column_specrH?s<->t-D EC((7+, 2,Aa,F 2 H !%m!4 5 D!)_M((="-KL ; $/$5C OD !  $83z?+J(3I(>C OH % M J!3s BBrsc_namefk resource_mapc>|d|dd||ddxs|ddS)zF https://specs.frictionlessdata.io/table-schema/#foreign-keys fields referenceresource)columnReferencerO)rPrNr)rIrJrKs rconvert_foreignKeyrQ[s<h<!+x8$R _Z%@%LHM  r#c d|dDcgc] }t|c}i}dD]N}t|tr|\}}n|}||vs ||||<|dk(s.||Dcgc]}t|||c}||<P|Scc}wcc}w)a :param rsc_name: `name` property of the resource the schema belongs to. Needed to resolve self-referential foreign keys. :param schema: `dict` parsed from JSON representing a frictionless Table Schema object. :param resource_map: `dict` mapping resource names to resource paths, needed to convert foreign key constraints. :return: `dict` suitable for instantiating a `csvw.metadata.Schema` object. columnsrM)) missingValuesnull primaryKey foreignKeysrW)rH isinstancetuplerQ)rIschemarKfrFrtoproprJs rconvert_table_schemar]ks vh7GH7G!*1-7GH IC dE "LD&F 6> ,CK}$X[\bXcdXcRT1(B MXcdF  JIes A4A9c|jdi}d|vr|d}i}|jdr|d|d<|jdr|d|d<dD]}||vs||||<d|vr|d|d<|S)zk Limitations: lineTerminator is not supported. https://specs.frictionlessdata.io/csv-dialect/ dialectcsv delimiterencoding)ra quoteChar doubleQuoteskipInitialSpaceheader commentChar commentPrefix)r)rscdrFrs rconvert_dialectrks  2A z eH Cuu[[>K wwzj/J 19$CI /O Jr#c(eZdZdZddZdeddfdZy) DataPackagez6 Metadata according to the frictionless spec. Nct|tr#|j|_|j|_yt|tr&t j |xsd|_||_yt|t j rB|xs |j|_tj|jd}||_ytj|}t j |xsd|_||_y)N.utf8)rb) rXrmr2dirdictpathlibPathparentloads read_text)selfr directorys r__init__zDataPackage.__init__s dK ( DIxxDH  dD !||I$45DH gll + /DKKDH::dnnfn=>D  ::d#D||I$45DH r#clsr6rcdddi}tj|j|d<dD]&\}}||jvs|j|||<(d|jvrAd|jvr|jd|d<n d|jvr|jd|d <|jjd gDcgc] }d |vs| }}|Dcic]}d|vs|d|d }}|D]}|jd }|s|jd dk(s,|jddk(sA|jdg|d t |jd||t |d} |dj | |j|} |jdz | _ | Scc}wcc}w)Nz@contextzhttp://www.w3.org/ns/csvwz dc:replaces) )id dc:identifier)licensesz dc:license)r9dc:title)homepagezdcat:accessURL)r;r<)sourcesz dc:source) contributorszdc:contributor)profilez dc:conformsTo)keywordsz dc:subject)createdz dc:createdr8r}r~r9r resourcespathrZschemefiler r`tables)url tableSchemar_zcsvw-metadata.json) r2dumpsr setdefaultr]rkappend fromvaluerq_fname) rxr{mdflpropcsvwproprirrKrZtablerFs r to_tablegroupzDataPackage.to_tablegroups(*EF JJtyy1= ! FH"#yy08  !  TYY 499$&*ii&7?# )!%6!2:%)IIMM+r$BT$BSfPSmS$B Trs  %(*.d38nc3h8   /3 8