o ]3|@sdZddlZddlZddlZddlZddlZddlZddlZddlm Z ddl Z ddl m Z m Z m Z mZddlmZmZmZmZmZddlmZddlmZddlmZdd lmZdd lmZdd lm Z dd l!m"Z"dd l#m$Z$ddl%m&Z&m'Z'm(Z(m)Z)m*Z*ddl+m,Z,ddl-m.Z.ddl/m0Z0ej1ej2ej3ej4ej5ej6dZ7e8gdZ9GdddZ:GdddZ;GdddeZ e>Z? eZVd?d@ZWdAdBZXdCdDZYdEdFZZdGdHZ[dIdJZ\dKdLZ]e?fdMdNZ^dS)OaTools for using Python's :mod:`json` module with BSON documents. This module provides two helper methods `dumps` and `loads` that wrap the native :mod:`json` methods and provide explicit BSON conversion to and from JSON. :class:`~bson.json_util.JSONOptions` provides a way to control how JSON is emitted and parsed, with the default being the legacy PyMongo format. :mod:`~bson.json_util` can also generate Canonical or Relaxed `Extended JSON`_ when :const:`CANONICAL_JSON_OPTIONS` or :const:`RELAXED_JSON_OPTIONS` is provided, respectively. .. _Extended JSON: https://github.com/mongodb/specifications/blob/master/source/extended-json.rst Example usage (deserialization): .. doctest:: >>> from bson.json_util import loads >>> loads('[{"foo": [1, 2]}, {"bar": {"hello": "world"}}, {"code": {"$scope": {}, "$code": "function x() { return 1; }"}}, {"bin": {"$type": "80", "$binary": "AQIDBA=="}}]') [{u'foo': [1, 2]}, {u'bar': {u'hello': u'world'}}, {u'code': Code('function x() { return 1; }', {})}, {u'bin': Binary('...', 128)}] Example usage (serialization): .. doctest:: >>> from bson import Binary, Code >>> from bson.json_util import dumps >>> dumps([{'foo': [1, 2]}, ... {'bar': {'hello': 'world'}}, ... {'code': Code("function x() { return 1; }", {})}, ... {'bin': Binary(b"")}]) '[{"foo": [1, 2]}, {"bar": {"hello": "world"}}, {"code": {"$code": "function x() { return 1; }", "$scope": {}}}, {"bin": {"$binary": "AQIDBA==", "$type": "00"}}]' Example usage (with :const:`CANONICAL_JSON_OPTIONS`): .. doctest:: >>> from bson import Binary, Code >>> from bson.json_util import dumps, CANONICAL_JSON_OPTIONS >>> dumps([{'foo': [1, 2]}, ... {'bar': {'hello': 'world'}}, ... {'code': Code("function x() { return 1; }")}, ... {'bin': Binary(b"")}], ... json_options=CANONICAL_JSON_OPTIONS) '[{"foo": [{"$numberInt": "1"}, {"$numberInt": "2"}]}, {"bar": {"hello": "world"}}, {"code": {"$code": "function x() { return 1; }"}}, {"bin": {"$binary": {"base64": "AQIDBA==", "subType": "00"}}}]' Example usage (with :const:`RELAXED_JSON_OPTIONS`): .. doctest:: >>> from bson import Binary, Code >>> from bson.json_util import dumps, RELAXED_JSON_OPTIONS >>> dumps([{'foo': [1, 2]}, ... {'bar': {'hello': 'world'}}, ... {'code': Code("function x() { return 1; }")}, ... {'bin': Binary(b"")}], ... json_options=RELAXED_JSON_OPTIONS) '[{"foo": [1, 2]}, {"bar": {"hello": "world"}}, {"code": {"$code": "function x() { return 1; }"}}, {"bin": {"$binary": {"base64": "AQIDBA==", "subType": "00"}}}]' Alternatively, you can manually pass the `default` to :func:`json.dumps`. It won't handle :class:`~bson.binary.Binary` and :class:`~bson.code.Code` instances (as they are extended strings you can't provide custom defaults), but it will be faster as there is less recursion. .. note:: If your application does not need the flexibility offered by :class:`JSONOptions` and spends a large amount of time in the `json_util` module, look to `python-bsonjs `_ for a nice performance improvement. `python-bsonjs` is a fast BSON to MongoDB Extended JSON converter for Python built on top of `libbson `_. `python-bsonjs` works best with PyMongo when using :class:`~bson.raw_bson.RawBSONDocument`. .. versionchanged:: 2.8 The output format for :class:`~bson.timestamp.Timestamp` has changed from '{"t": , "i": }' to '{"$timestamp": {"t": , "i": }}'. This new format will be decoded to an instance of :class:`~bson.timestamp.Timestamp`. The old format will continue to be decoded to a python dict as before. Encoding to the old format is no longer supported as it was never correct and loses type information. Added support for $numberLong and $undefined - new in MongoDB 2.6 - and parsing $date in ISO-8601 format. .. versionchanged:: 2.7 Preserves order when rendering SON, Timestamp, Code, Binary, and DBRef instances. .. versionchanged:: 2.3 Added dumps and loads helpers to automatically handle conversion to and from json and supports :class:`~bson.binary.Binary` and :class:`~bson.code.Code` N)ConfigurationError) EPOCH_AWARE EPOCH_NAIVERE_TYPESON)Binary JAVA_LEGACY CSHARP_LEGACYOLD_UUID_SUBTYPE UUID_SUBTYPE)Code) CodecOptions)DBRef) Decimal128)Int64)MaxKey)MinKey)ObjectId)PY3 iteritems integer_types string_type text_type)Regex) Timestamp)utc)ilmsux)$id$ref$dbc@eZdZdZ dZ dZdS)DatetimeRepresentationrN)__name__ __module__ __qualname__LEGACY NUMBERLONGISO8601r/r/@/var/www/html/env/lib/python3.10/site-packages/bson/json_util.pyr&s  r&c@r%)JSONModerr'r(N)r)r*r+r,RELAXED CANONICALr/r/r/r0r1s r1cs:eZdZdZdejdejffdd ZfddZZ S) JSONOptionsa*Encapsulates JSON options for :func:`dumps` and :func:`loads`. :Parameters: - `strict_number_long`: If ``True``, :class:`~bson.int64.Int64` objects are encoded to MongoDB Extended JSON's *Strict mode* type `NumberLong`, ie ``'{"$numberLong": "" }'``. Otherwise they will be encoded as an `int`. Defaults to ``False``. - `datetime_representation`: The representation to use when encoding instances of :class:`datetime.datetime`. Defaults to :const:`~DatetimeRepresentation.LEGACY`. - `strict_uuid`: If ``True``, :class:`uuid.UUID` object are encoded to MongoDB Extended JSON's *Strict mode* type `Binary`. Otherwise it will be encoded as ``'{"$uuid": "" }'``. Defaults to ``False``. - `json_mode`: The :class:`JSONMode` to use when encoding BSON types to Extended JSON. Defaults to :const:`~JSONMode.LEGACY`. - `document_class`: BSON documents returned by :func:`loads` will be decoded to an instance of this class. Must be a subclass of :class:`collections.MutableMapping`. Defaults to :class:`dict`. - `uuid_representation`: The BSON representation to use when encoding and decoding instances of :class:`uuid.UUID`. Defaults to :const:`~bson.binary.PYTHON_LEGACY`. - `tz_aware`: If ``True``, MongoDB Extended JSON's *Strict mode* type `Date` will be decoded to timezone aware instances of :class:`datetime.datetime`. Otherwise they will be naive. Defaults to ``True``. - `tzinfo`: A :class:`datetime.tzinfo` subclass that specifies the timezone from which :class:`~datetime.datetime` objects should be decoded. Defaults to :const:`~bson.tz_util.utc`. - `args`: arguments to :class:`~bson.codec_options.CodecOptions` - `kwargs`: arguments to :class:`~bson.codec_options.CodecOptions` .. seealso:: The specification for Relaxed and Canonical `Extended JSON`_. .. versionadded:: 3.4 .. versionchanged:: 3.5 Accepts the optional parameter `json_mode`. Fcs|dd|d<|dr|dt|d<|tjtjtjfvr"tdtt|j |g|Ri|}|t jt j t j fvr?td||_ |j t j krTd|_tj|_d|_|S|j t j krfd|_tj|_d|_|S||_||_||_|S)Ntz_awareTtzinfoznJSONOptions.datetime_representation must be one of LEGACY, NUMBERLONG, or ISO8601 from DatetimeRepresentation.zQJSONOptions.json_mode must be one of LEGACY, RELAXED, or CANONICAL from JSONMode.F)getrr&r,r-r.rsuperr4__new__r1r2r3 json_modestrict_number_longdatetime_representation strict_uuid)clsr;r<r=r:argskwargsself __class__r/r0r9sB  zJSONOptions.__new__cs$d|j|j|j|jtt|fS)NzSstrict_number_long=%r, datetime_representation=%r, strict_uuid=%r, json_mode=%r, %s)r;r<r=r:r8r4_arguments_repr)rArBr/r0rD1s zJSONOptions._arguments_repr) r)r*r+__doc__r&r,r1r9rD __classcell__r/r/rBr0r4s(#r4)r:T)r;r<r=cOs*|dt}tjt||g|Ri|S)aWHelper function that wraps :func:`json.dumps`. Recursive function that handles all BSON types including :class:`~bson.binary.Binary` and :class:`~bson.code.Code`. :Parameters: - `json_options`: A :class:`JSONOptions` instance used to modify the encoding of MongoDB Extended JSON types. Defaults to :const:`DEFAULT_JSON_OPTIONS`. .. versionchanged:: 3.4 Accepts optional parameter `json_options`. See :class:`JSONOptions`. .. versionchanged:: 2.7 Preserves order when rendering SON, Timestamp, Code, Binary, and DBRef instances. json_options)popDEFAULT_JSON_OPTIONSjsondumps _json_convert)objr?r@rGr/r/r0rKls rKcs4|dtfdd|d<tj|g|Ri|S)aHelper function that wraps :func:`json.loads`. Automatically passes the object_hook for BSON type conversion. Raises ``TypeError``, ``ValueError``, ``KeyError``, or :exc:`~bson.errors.InvalidId` on invalid MongoDB Extended JSON. :Parameters: - `json_options`: A :class:`JSONOptions` instance used to modify the decoding of MongoDB Extended JSON types. Defaults to :const:`DEFAULT_JSON_OPTIONS`. .. versionchanged:: 3.5 Parses Relaxed and Canonical Extended JSON as well as PyMongo's legacy format. Now raises ``TypeError`` or ``ValueError`` when parsing JSON type wrappers with values of the wrong type or any extra keys. .. versionchanged:: 3.4 Accepts optional parameter `json_options`. See :class:`JSONOptions`. rGcs t|SN)object_pairs_hook)pairsrGr/r0szloads..rO)rHrIrJloads)rr?r@r/rQr0rSs rScst|ds t|drtfddt|DSt|dr.t|ttfs.tfdd|DSzt|WSty?|YSw)z]Recursive helper method that converts BSON types so they can be converted into json. ritemsc3s"|] \}}|t|fVqdSrNrL).0kvrQr/r0 sz _json_convert..__iter__c3s|]}t|VqdSrNrU)rVrXrQr/r0rYs) hasattrrr isinstancerbyteslistdefault TypeError)rMrGr/rQr0rLs   rLcCst|||SrN) object_hookdocument_class)rPrGr/r/r0rOsrOcCsHd|vrt|Sd|vrt|Sd|vrt||Sd|vr!t|Sd|vr)t|Sd|vr1t|Sd|vrCd|vr>t||St||Sd |vrKt|Sd |vrSt |Sd |vrYdSd |vrat |Sd |vrr|d }t |d|dSd|vrzt |Sd|vrt |Sd|vrt|Sd|vrt|Sd|vrt|Sd|vrt|S|S)N$oidr#$date$regex$minKey$maxKey$binary$type$code$uuidz $undefined $numberLong $timestamptr$numberDecimal $dbPointer$regularExpression$symbol $numberInt $numberDouble)_parse_canonical_oid_parse_canonical_dbref_parse_canonical_datetime_parse_legacy_regex_parse_canonical_minkey_parse_canonical_maxkey_parse_legacy_binary_parse_canonical_binary_parse_canonical_code_parse_legacy_uuid_parse_canonical_int64r_parse_canonical_decimal128_parse_canonical_dbpointer_parse_canonical_regex_parse_canonical_symbol_parse_canonical_int32_parse_canonical_double)dctrGtspr/r/r0rasP   racCsF|d}t|tr |Sd}|ddD] }|t|dO}qt||S)Nrer$options)r\rr7 _RE_OPT_TABLE)docpatternflagsoptr/r/r0rxs  rxcCs(t|dkr td|ft|dS)z*Decode a JSON legacy $uuid to Python UUID.r'zBad $uuid, extra field(s): %srk)lenr`uuidUUIDrr/r/r0r~s r~cCs~|tkr(|jtkrtj|dS|jtkr"|ddd|ddd}tj|dS|tkr2tj|dStr:|dkr:|St||S)N)bytes_le)r]r) r uuid_representationr rrrr rrdatasubtyperGr/r/r0_binary_or_uuids       rcCsht|dtrd|d|d<t|dd}|dkr%t|dddd}t|d}t|||S)Nri%02xlrh)r\intbase64 b64decodeencoder)rrGrrr/r/r0r{s r{cCs|d}|d}|d}t|tstd|ft|tr#t|dkr*td|ft|dkr7td|ft|}t|t|d|S) NrhrsubTypez#$binary base64 must be a string: %sr(z9$binary subType must be a string at most 2 characters: %sz?$binary must include only "base64" and "subType" components: %sr) r\rr`rrrrrr)rrGbinaryb64rrr/r/r0r|s  r|c Cs"|d}t|dkrtd|ft|tr |ddkr&|dd}d}nC|ddvr?|d d kr?|dd}|dd}n*|d dvrR|dd }|d d}n|d dvre|dd }|d d}n|}d }|d }d}|dkrtt||dd}|d|}tj|dj |t d}|r|dkrt|dkr|dd d \}} t|dt| d} n+t|dkrt|dddt|ddd} nt|dkrt|ddd} |ddkr| d9} |tj | d}|j r|jr||j}|S|j ddStt||S)z3Decode a JSON datetime to python datetime.datetime.rdr'zBad $date, extra field(s): %srZNi)+-:r.ri@B%Y-%m-%dT%H:%M:%S) microsecondr6ri<r)secondsr6)rr`r\rrfindrfloatdatetimestrptimereplacersplit timedeltar5r6 astimezonebson_millis_to_datetime) rrGdtmdtoffset dot_indexrawarehoursminutessecsr/r/r0rws\              *    rwcCs&t|dkr td|ft|dS)z1Decode a JSON ObjectId to bson.objectid.ObjectId.r'zBad $oid, extra field(s): %src)rr`rrr/r/r0ruTs  rucC*|d}t|dkrtd|ft|S)z&Decode a JSON symbol to Python string.rrr'zBad $symbol, extra field(s): %s)rr`r)rsymbolr/r/r0r[ rcCs6|D] }|dvrtd|fqt|d|ddS)z%Decode a JSON code to bson.code.Code.)rj$scopezBad $code, extra field(s): %srjr)scope)r`r r7rkeyr/r/r0r}cs r}cCsN|d}t|dkrtd|ft|dkrtd|ft|d|dS)z(Decode a JSON regex to bson.regex.Regex.rqr'z*Bad $regularExpression, extra field(s): %sr(zNBad $regularExpression must include only "pattern"and "options" components: %sroptions)rr`r)rregexr/r/r0rks  rcCsN|D]}|dr|tvr|Sqt|d|dfd|ddi|S)z(Decode a JSON DBRef to bson.dbref.DBRef.$r#r"databaser$N) startswith _DBREF_KEYSrrHrr/r/r0rvvs rvcCs|d}t|dkrtd|ft|trB|}|jdur&td|ft|jts3td|ft|dkr@td|f|Std |f) z9Decode a JSON (deprecated) DBPointer to bson.dbref.DBRef.rpr'z"Bad $dbPointer, extra field(s): %sNz#Bad $dbPointer, extra field $db: %sz+Bad $dbPointer, $id must be an ObjectId: %sr(z+Bad $dbPointer, extra field(s) in DBRef: %sz$Bad $dbPointer, expected a DBRef: %s)rr`r\ras_docridr)rdbref dbref_docr/r/r0rs&     rcCB|d}t|dkrtd|ft|tstd|ft|S)z"Decode a JSON int32 to python int.rsr'z"Bad $numberInt, extra field(s): %sz$numberInt must be string: %s)rr`r\rr)ri_strr/r/r0r   rcCr)z(Decode a JSON int64 to bson.int64.Int64.rlr'z#Bad $numberLong, extra field(s): %s)rr`r)rl_strr/r/r0rrrcCr)z%Decode a JSON double to python float.rtr'z%Bad $numberDouble, extra field(s): %sz $numberDouble must be string: %s)rr`r\rrrd_strr/r/r0rrrcCr)z7Decode a JSON decimal128 to bson.decimal128.Decimal128.ror'z&Bad $numberDecimal, extra field(s): %sz!$numberDecimal must be string: %s)rr`r\rrrr/r/r0rrrcCsJt|dtus|ddkrtd|ft|dkr"td|ftS)z,Decode a JSON MinKey to bson.min_key.MinKey.rfr'z$minKey value must be 1: %sBad $minKey, extra field(s): %s)typerr`rrrr/r/r0rys  rycCsHt|dtus|ddkrtd|ft|dkr!td|ftS)z,Decode a JSON MaxKey to bson.max_key.MaxKey.rgr'z$maxKey value must be 1: %sr)rrr`rrrr/r/r0rzs   rzcCsT|jtjkrtdt|fdd|fgSdtdt|fdd|fgiS)Nrhrirrr)r:r1r,rr b64encodedecoderr/r/r0_encode_binarys   rc Cs:t|tr dt|iSt|trt||dSt|tjr||jtj kre|j s-|j t d}|t kre|j |}|j|j|jfdkrDd}n|d}t|jd}|rWd|fnd }d d |d ||fiSt|}|jtjkrtd |iSd d t|iiS|jrt|trd t|iSt|ttfrd }|jtj@r|d7}|jtj@r|d7}|jtj @r|d7}|jtj!@r|d7}|jtj"@r|d7}|jtj#@r|d7}t|j$t%r|j$}n|j$&d}|j't(jkrt)d|fd|fgSdt)d|fd|fgiSt|t*rddiSt|t+rddiSt|t,r#dt)d|j-fd|j.fgiSt|t/rE|j0dur5dt|iSt)dt|fd t|j0|fgSt|t1rRt2||j3|St4rat|t5rat2|d!|St|t6j7r|j8r|j5}t9} |j:t;kr{|j<}n|j:t=kr|d"dd#|dd"d#}n|j:t>krt>} t2|| |Sd$|j?iSt|t@rd%t|iSt|tAr|S|j't(jBkrt|tCrd&|krd'krnnd(t%|iSd t%|iS|j't(jkrt|tDrtEF|rd)d*iStEG|r|d!krd+nd,} d)| iS|j't(jBkrd)t%tH|iStId-|).NrcrQr)rrrrz%ziz.%03drrdz%s%s%srrlrrrrr r!zutf-8rerrqrrrfr'rgrmrnrjrrrrrkroilrsrtNaNInfinityz -Infinityz%r is not JSON serializable)Jr\rstrrrLrrr<r&r.r6rrr utcoffsetdaysr microsecondsstrftimerrr_datetime_to_millisr,r;rrrrre IGNORECASELOCALE MULTILINEDOTALLUNICODEVERBOSErrrr:r1rrrrtimeincr rrrrrr]rrr=r rr rrr hexrboolr3rrmathisnanisinfreprr`) rMrGoff tz_stringmillisfracsecsrrrrrepresentationr/r/r0r_s                                          r_)_rErrrJrrsysrpymongo.errorsrrrrrr bson.binaryrrr r r bson.coder bson.codec_optionsr bson.dbrefrbson.decimal128r bson.int64r bson.max_keyr bson.min_keyr bson.objectidrbson.py3compatrrrrr bson.regexrbson.timestampr bson.tz_utilrILMSUXr frozensetrr&r1r4r,LEGACY_JSON_OPTIONSrIr3CANONICAL_JSON_OPTIONSr2RELAXED_JSON_OPTIONSr.STRICT_JSON_OPTIONSrKrSrLrOrarxr~rr{r|rwrurr}rrvrrrrrryrzrr_r/r/r/r0s]             $+ W      ,  ;