[6a3a178] | 1 | # combined-stream
|
---|
| 2 |
|
---|
| 3 | A stream that emits multiple other streams one after another.
|
---|
| 4 |
|
---|
| 5 | **NB** Currently `combined-stream` works with streams version 1 only. There is ongoing effort to switch this library to streams version 2. Any help is welcome. :) Meanwhile you can explore other libraries that provide streams2 support with more or less compatibility with `combined-stream`.
|
---|
| 6 |
|
---|
| 7 | - [combined-stream2](https://www.npmjs.com/package/combined-stream2): A drop-in streams2-compatible replacement for the combined-stream module.
|
---|
| 8 |
|
---|
| 9 | - [multistream](https://www.npmjs.com/package/multistream): A stream that emits multiple other streams one after another.
|
---|
| 10 |
|
---|
| 11 | ## Installation
|
---|
| 12 |
|
---|
| 13 | ``` bash
|
---|
| 14 | npm install combined-stream
|
---|
| 15 | ```
|
---|
| 16 |
|
---|
| 17 | ## Usage
|
---|
| 18 |
|
---|
| 19 | Here is a simple example that shows how you can use combined-stream to combine
|
---|
| 20 | two files into one:
|
---|
| 21 |
|
---|
| 22 | ``` javascript
|
---|
| 23 | var CombinedStream = require('combined-stream');
|
---|
| 24 | var fs = require('fs');
|
---|
| 25 |
|
---|
| 26 | var combinedStream = CombinedStream.create();
|
---|
| 27 | combinedStream.append(fs.createReadStream('file1.txt'));
|
---|
| 28 | combinedStream.append(fs.createReadStream('file2.txt'));
|
---|
| 29 |
|
---|
| 30 | combinedStream.pipe(fs.createWriteStream('combined.txt'));
|
---|
| 31 | ```
|
---|
| 32 |
|
---|
| 33 | While the example above works great, it will pause all source streams until
|
---|
| 34 | they are needed. If you don't want that to happen, you can set `pauseStreams`
|
---|
| 35 | to `false`:
|
---|
| 36 |
|
---|
| 37 | ``` javascript
|
---|
| 38 | var CombinedStream = require('combined-stream');
|
---|
| 39 | var fs = require('fs');
|
---|
| 40 |
|
---|
| 41 | var combinedStream = CombinedStream.create({pauseStreams: false});
|
---|
| 42 | combinedStream.append(fs.createReadStream('file1.txt'));
|
---|
| 43 | combinedStream.append(fs.createReadStream('file2.txt'));
|
---|
| 44 |
|
---|
| 45 | combinedStream.pipe(fs.createWriteStream('combined.txt'));
|
---|
| 46 | ```
|
---|
| 47 |
|
---|
| 48 | However, what if you don't have all the source streams yet, or you don't want
|
---|
| 49 | to allocate the resources (file descriptors, memory, etc.) for them right away?
|
---|
| 50 | Well, in that case you can simply provide a callback that supplies the stream
|
---|
| 51 | by calling a `next()` function:
|
---|
| 52 |
|
---|
| 53 | ``` javascript
|
---|
| 54 | var CombinedStream = require('combined-stream');
|
---|
| 55 | var fs = require('fs');
|
---|
| 56 |
|
---|
| 57 | var combinedStream = CombinedStream.create();
|
---|
| 58 | combinedStream.append(function(next) {
|
---|
| 59 | next(fs.createReadStream('file1.txt'));
|
---|
| 60 | });
|
---|
| 61 | combinedStream.append(function(next) {
|
---|
| 62 | next(fs.createReadStream('file2.txt'));
|
---|
| 63 | });
|
---|
| 64 |
|
---|
| 65 | combinedStream.pipe(fs.createWriteStream('combined.txt'));
|
---|
| 66 | ```
|
---|
| 67 |
|
---|
| 68 | ## API
|
---|
| 69 |
|
---|
| 70 | ### CombinedStream.create([options])
|
---|
| 71 |
|
---|
| 72 | Returns a new combined stream object. Available options are:
|
---|
| 73 |
|
---|
| 74 | * `maxDataSize`
|
---|
| 75 | * `pauseStreams`
|
---|
| 76 |
|
---|
| 77 | The effect of those options is described below.
|
---|
| 78 |
|
---|
| 79 | ### combinedStream.pauseStreams = `true`
|
---|
| 80 |
|
---|
| 81 | Whether to apply back pressure to the underlaying streams. If set to `false`,
|
---|
| 82 | the underlaying streams will never be paused. If set to `true`, the
|
---|
| 83 | underlaying streams will be paused right after being appended, as well as when
|
---|
| 84 | `delayedStream.pipe()` wants to throttle.
|
---|
| 85 |
|
---|
| 86 | ### combinedStream.maxDataSize = `2 * 1024 * 1024`
|
---|
| 87 |
|
---|
| 88 | The maximum amount of bytes (or characters) to buffer for all source streams.
|
---|
| 89 | If this value is exceeded, `combinedStream` emits an `'error'` event.
|
---|
| 90 |
|
---|
| 91 | ### combinedStream.dataSize = `0`
|
---|
| 92 |
|
---|
| 93 | The amount of bytes (or characters) currently buffered by `combinedStream`.
|
---|
| 94 |
|
---|
| 95 | ### combinedStream.append(stream)
|
---|
| 96 |
|
---|
| 97 | Appends the given `stream` to the combinedStream object. If `pauseStreams` is
|
---|
| 98 | set to `true, this stream will also be paused right away.
|
---|
| 99 |
|
---|
| 100 | `streams` can also be a function that takes one parameter called `next`. `next`
|
---|
| 101 | is a function that must be invoked in order to provide the `next` stream, see
|
---|
| 102 | example above.
|
---|
| 103 |
|
---|
| 104 | Regardless of how the `stream` is appended, combined-stream always attaches an
|
---|
| 105 | `'error'` listener to it, so you don't have to do that manually.
|
---|
| 106 |
|
---|
| 107 | Special case: `stream` can also be a String or Buffer.
|
---|
| 108 |
|
---|
| 109 | ### combinedStream.write(data)
|
---|
| 110 |
|
---|
| 111 | You should not call this, `combinedStream` takes care of piping the appended
|
---|
| 112 | streams into itself for you.
|
---|
| 113 |
|
---|
| 114 | ### combinedStream.resume()
|
---|
| 115 |
|
---|
| 116 | Causes `combinedStream` to start drain the streams it manages. The function is
|
---|
| 117 | idempotent, and also emits a `'resume'` event each time which usually goes to
|
---|
| 118 | the stream that is currently being drained.
|
---|
| 119 |
|
---|
| 120 | ### combinedStream.pause();
|
---|
| 121 |
|
---|
| 122 | If `combinedStream.pauseStreams` is set to `false`, this does nothing.
|
---|
| 123 | Otherwise a `'pause'` event is emitted, this goes to the stream that is
|
---|
| 124 | currently being drained, so you can use it to apply back pressure.
|
---|
| 125 |
|
---|
| 126 | ### combinedStream.end();
|
---|
| 127 |
|
---|
| 128 | Sets `combinedStream.writable` to false, emits an `'end'` event, and removes
|
---|
| 129 | all streams from the queue.
|
---|
| 130 |
|
---|
| 131 | ### combinedStream.destroy();
|
---|
| 132 |
|
---|
| 133 | Same as `combinedStream.end()`, except it emits a `'close'` event instead of
|
---|
| 134 | `'end'`.
|
---|
| 135 |
|
---|
| 136 | ## License
|
---|
| 137 |
|
---|
| 138 | combined-stream is licensed under the MIT license.
|
---|