#HJjTdZddlmZddlZddlmZmZmZerddlm Z GddZ y)zEImplements ByteBuffer class for amortizing network transfer overhead.) annotationsN)IO TYPE_CHECKINGcast)IterablecfeZdZdZej fd dZd dZd d dZd d dZ ddZ d ddZ ddZ y ) ByteBufferaByte buffer that allows callers to read data with minimal copying, and has a fast ``__len__`` method. The buffer is parametrized by its ``chunk_size``, which is the number of bytes that it will read in from the supplied reader or iterable when the buffer is being filled. As the primary use case for this buffer is to amortize the overhead costs of transferring data over the network (rather than capping memory consumption), it leads to more predictable performance to always read the same amount of bytes each time the buffer is filled, hence the ``chunk_size`` parameter instead of some fixed capacity. The bytes are stored in a bytestring, and previously-read bytes are freed when the buffer is next filled (by slicing the bytestring into a smaller copy). Args: chunk_size: The number of bytes that will be read from the supplied reader or iterable when filling the buffer. Example: >>> buf = ByteBuffer(chunk_size=8) >>> message_bytes = iter([b"Hello, W", b"orld!"]) >>> buf.fill(message_bytes) 8 >>> len(buf) # only chunk_size bytes are filled 8 >>> buf.peek() b'Hello, W' >>> len(buf) # peek() does not change read position 8 >>> buf.read(6) b'Hello,' >>> len(buf) # read() does change read position 2 >>> buf.fill(message_bytes) 5 >>> buf.read() b' World!' >>> len(buf) 0 c2||_|jy)N) _chunk_sizeempty)self chunk_sizes _/Users/ahmed/devFolder/claude-voice/.venv/lib/python3.12/site-packages/smart_open/bytebuffer.py__init__zByteBuffer.__init__<s% cFt|j|jz S)z:Return the number of unread bytes in the buffer as an int.)len_bytes_posr s r__len__zByteBuffer.__len__@s4;;$))++rcd|j|}|xjt|z c_|S)aRead bytes from the buffer and advance the read position. Args: size: Maximum number of bytes to read. If negative or not supplied, read all unread bytes in the buffer. Returns: The bytes read from the buffer. )peekrr)r sizeparts rreadzByteBuffer.readDs(yy SY  rc|dks|t|kDr t|}t|j|j|j|zS)aGet bytes from the buffer without advancing the read position. Args: size: Maximum number of bytes to return. If negative or not supplied, return all unread bytes in the buffer. Returns: The peeked bytes from the buffer. r)rbytesrr)r rs rrzByteBuffer.peekRsB !8tc$i't9DT[[TYY-=>??rc0t|_d|_y)z!Remove all bytes from the buffer.rN) bytearrayrrrs rr zByteBuffer.emptyask  rc|dk\r|n |j}t||j}|jdk7r%|j|jd|_d|_t |drt d|j |}n&t}|D]}||z }t||k\sn|xj|z c_t|S)a Fill the buffer with bytes from source. Reads from ``source`` until one of these conditions is met: * ``size`` bytes have been read from source (if ``size >= 0``); * ``chunk_size`` bytes have been read from source; * no more bytes can be read from source. Note: All previously-read bytes in the buffer are removed. Args: source: The source of bytes to fill the buffer with, either a file-like object or an iterable/list of bytes. If this argument has the ``read`` attribute, it's assumed to be a file-like object and ``read`` is called to get the bytes; otherwise it's assumed to be an iterable or list that contains bytes, and a for loop is used to get the bytes. size: The number of bytes to try to read from source. If not supplied, negative, or larger than the buffer's ``chunk_size``, then ``chunk_size`` bytes are read. Note that if source is an iterable or list, then it's possible that more than size bytes will be read if iterating over source produces more than one byte at a time. Returns: The number of new bytes added to the buffer. rNrz IO[bytes]) r minrrhasattrrrr r)r sourcer new_bytes more_bytess rfillzByteBuffer.fillfs6qytd&6&64))* 99>++diik2DKDI 66 "[&166tT)% y 9~rc|jj||j}|dk(r t|n||jz dz}|j |S)aaRead a line from this buffer efficiently. A line is a contiguous sequence of bytes that ends with either: 1. The ``terminator`` character 2. The end of the buffer itself Args: terminator: The line terminator byte. Returns: The line bytes (including the terminator if present). )rfindrrr)r terminatorindexrs rreadlinezByteBuffer.readlinesK   TYY7!RKs4yUTYY->-ByyrN)rintreturnNone)r0r/)r))rr/r0r)r0r1)r$zIO[bytes] | Iterable[bytes]rr/r0r/)r,rr0r) __name__ __module__ __qualname____doc__ioDEFAULT_BUFFER_SIZErrrrr r'r.rrr r s8'R*,)?)?,  @ ,\rr ) r5 __future__rr6typingrrrcollections.abcrr r8rrr<s)L" **(RRr