Data nodes

Shape, filter, store and fetch data: tables, HTTP, dates, TOTP codes.

Generated from the node definitions in src/lib/flow/node/data/ and the English labels (component.flow.node.data). Every node also has the common settings.

Contents

• Aggregate — data/aggregate
• Date & time — data/date
• Filter — data/filter
• HTTP request — data/http
• Limit — data/limit
• Random pick — data/random
• Set fields — data/set
• Sort — data/sort
• Split text — data/split
• Data table — data/table
• 2FA code — data/totp
• Remove duplicates — data/unique
• Summarize — data/summarize
• Compare — data/compare
• Crypto — data/crypto
• HTML — data/html
• Convert — data/convert
• RSS — data/rss
• Store — data/store
• Code — data/code
• Next post — data/post

Aggregate

data/aggregate · icon sigma

Combines many items into one value

Fields

Output dots

• next — Next

Output shape

Later nodes read it as {{ nodes.<id>.output… }}.

{
  "value": "unknown"
}

Example node

{
  "id": "aggregate",
  "type": "data/aggregate",
  "name": "Aggregate",
  "field": {
    "operation": "collect",
    "separator": ", "
  },
  "setting": {
    "retry": {
      "count": 0,
      "waitMs": 1000,
      "backoff": "fixed"
    },
    "error": { "mode": "stop", "fallback": null, "break": { "count": 3, "waitMs": 600000 } },
    "timeoutMs": 60000,
    "disabled": false
  },
  "pin": null
}

Date & time

data/date · icon calendar

Gets, formats, shifts or compares dates

Fields

Output dots

• next — Next

Output shape

Later nodes read it as {{ nodes.<id>.output… }}.

{
  "iso": "string",
  "unix": "number",
  "text": "string",
  "date": "string",
  "time": "string",
  "weekday": "string",
  "value": "number"
}

Example node

{
  "id": "date",
  "type": "data/date",
  "name": "Date & time",
  "field": {
    "operation": "now",
    "amount": 0,
    "unit": "minutes"
  },
  "setting": {
    "retry": {
      "count": 0,
      "waitMs": 1000,
      "backoff": "fixed"
    },
    "error": { "mode": "stop", "fallback": null, "break": { "count": 3, "waitMs": 600000 } },
    "timeoutMs": 60000,
    "disabled": false
  },
  "pin": null
}

Filter

data/filter · icon filter

Keeps the items that match conditions

Fields

Output dots

• next — Next
• empty — Empty

Output shape

Later nodes read it as {{ nodes.<id>.output… }}.

{
  "items": [
    "unknown"
  ],
  "removed": "number"
}

Example node

{
  "id": "filter",
  "type": "data/filter",
  "name": "Filter",
  "field": {
    "combine": "and",
    "condition": [
      {
        "path": "",
        "operator": "notEmpty",
        "value": ""
      }
    ]
  },
  "setting": {
    "retry": {
      "count": 0,
      "waitMs": 1000,
      "backoff": "fixed"
    },
    "error": { "mode": "stop", "fallback": null, "break": { "count": 3, "waitMs": 600000 } },
    "timeoutMs": 60000,
    "disabled": false
  },
  "pin": null
}

HTTP request

data/http · icon globe-lock

Calls an API or webhook. With Authentication: A credential, it adds the 's headers and query to the request; an OAuth2 credential answered 401 is refreshed once and the call sent again.

Fields

Output dots

• next — Next
• error — Error

Output shape

Later nodes read it as {{ nodes.<id>.output… }}.

{
  "status": "number",
  "header": "unknown",
  "body": "unknown",
  "page": "number"
}

Example node

{
  "id": "http",
  "type": "data/http",
  "name": "HTTP request",
  "field": {
    "method": "GET",
    "timeoutMs": 30000
  },
  "setting": {
    "retry": {
      "count": 0,
      "waitMs": 1000,
      "backoff": "fixed"
    },
    "error": { "mode": "stop", "fallback": null, "break": { "count": 3, "waitMs": 600000 } },
    "timeoutMs": 60000,
    "disabled": false
  },
  "pin": null
}

Limit

data/limit · icon list-filter

Keeps the first or last N items

Fields

Output dots

• next — Next

Output shape

Later nodes read it as {{ nodes.<id>.output… }}.

{
  "items": [
    "unknown"
  ]
}

Example node

{
  "id": "limit",
  "type": "data/limit",
  "name": "Limit",
  "field": {
    "count": 5,
    "from": "start"
  },
  "setting": {
    "retry": {
      "count": 0,
      "waitMs": 1000,
      "backoff": "fixed"
    },
    "error": { "mode": "stop", "fallback": null, "break": { "count": 3, "waitMs": 600000 } },
    "timeoutMs": 60000,
    "disabled": false
  },
  "pin": null
}

Random pick

data/random · icon shuffle

Picks random items from a list

Fields

Output dots

• next — Next
• empty — Empty

Output shape

Later nodes read it as {{ nodes.<id>.output… }}.

{
  "items": [
    "unknown"
  ],
  "item": "unknown"
}

Example node

{
  "id": "random",
  "type": "data/random",
  "name": "Random pick",
  "field": {
    "count": 1
  },
  "setting": {
    "retry": {
      "count": 0,
      "waitMs": 1000,
      "backoff": "fixed"
    },
    "error": { "mode": "stop", "fallback": null, "break": { "count": 3, "waitMs": 600000 } },
    "timeoutMs": 60000,
    "disabled": false
  },
  "pin": null
}

Set fields

data/set · icon pencil

Sets, removes and renames fields

Fields

Output dots

• next — Next

Output shape

Later nodes read it as {{ nodes.<id>.output… }}.

"the item it got (unchanged), or what its code returns"

Example node

{
  "id": "set",
  "type": "data/set",
  "name": "Set fields",
  "field": {
    "field": [
      {
        "name": "",
        "value": ""
      }
    ]
  },
  "setting": {
    "retry": {
      "count": 0,
      "waitMs": 1000,
      "backoff": "fixed"
    },
    "error": { "mode": "stop", "fallback": null, "break": { "count": 3, "waitMs": 600000 } },
    "timeoutMs": 60000,
    "disabled": false
  },
  "pin": null
}

Sort

data/sort · icon arrow-down-wide-narrow

Sorts a list by a field

Fields

Output dots

• next — Next

Output shape

Later nodes read it as {{ nodes.<id>.output… }}.

{
  "items": [
    "unknown"
  ]
}

Example node

{
  "id": "sort",
  "type": "data/sort",
  "name": "Sort",
  "field": {
    "direction": "asc"
  },
  "setting": {
    "retry": {
      "count": 0,
      "waitMs": 1000,
      "backoff": "fixed"
    },
    "error": { "mode": "stop", "fallback": null, "break": { "count": 3, "waitMs": 600000 } },
    "timeoutMs": 60000,
    "disabled": false
  },
  "pin": null
}

Split text

data/split · icon scissors

Turns text into a list

Fields

Output dots

• next — Next

Output shape

Later nodes read it as {{ nodes.<id>.output… }}.

{
  "items": [
    "unknown"
  ]
}

Example node

{
  "id": "split",
  "type": "data/split",
  "name": "Split text",
  "field": {
    "separator": ",",
    "trim": true
  },
  "setting": {
    "retry": {
      "count": 0,
      "waitMs": 1000,
      "backoff": "fixed"
    },
    "error": { "mode": "stop", "fallback": null, "break": { "count": 3, "waitMs": 600000 } },
    "timeoutMs": 60000,
    "disabled": false
  },
  "pin": null
}

Data table

data/table · icon table-2

Finds, adds, changes or deletes rows in one of your tables

Fields

Output dots

• next — Next
• empty — Nothing found

Output shape

Later nodes read it as {{ nodes.<id>.output… }}.

{
  "rows": [
    "unknown"
  ],
  "row": "unknown",
  "count": "number"
}

Example node

{
  "id": "table",
  "type": "data/table",
  "name": "Data table",
  "field": {
    "operation": "find",
    "limit": 100,
    "direction": "desc"
  },
  "setting": {
    "retry": {
      "count": 0,
      "waitMs": 1000,
      "backoff": "fixed"
    },
    "error": { "mode": "stop", "fallback": null, "break": { "count": 3, "waitMs": 600000 } },
    "timeoutMs": 60000,
    "disabled": false
  },
  "pin": null
}

2FA code

data/totp · icon key-round

The account's current authenticator code

Fields

Output dots

• next — Next
• none — No 2FA

Output shape

Later nodes read it as {{ nodes.<id>.output… }}.

{
  "code": "string",
  "expiresInMs": "number"
}

Example node

{
  "id": "totp",
  "type": "data/totp",
  "name": "2FA code",
  "field": {},
  "setting": {
    "retry": {
      "count": 0,
      "waitMs": 1000,
      "backoff": "fixed"
    },
    "error": { "mode": "stop", "fallback": null, "break": { "count": 3, "waitMs": 600000 } },
    "timeoutMs": 60000,
    "disabled": false
  },
  "pin": null
}

Remove duplicates

data/unique · icon list-x

Drops repeated items

Fields

Output dots

• next — Next

Output shape

Later nodes read it as {{ nodes.<id>.output… }}.

{
  "items": [
    "unknown"
  ],
  "removed": "number"
}

Example node

{
  "id": "unique",
  "type": "data/unique",
  "name": "Remove duplicates",
  "field": {},
  "setting": {
    "retry": {
      "count": 0,
      "waitMs": 1000,
      "backoff": "fixed"
    },
    "error": { "mode": "stop", "fallback": null, "break": { "count": 3, "waitMs": 600000 } },
    "timeoutMs": 60000,
    "disabled": false
  },
  "pin": null
}

Summarize

data/summarize · icon sigma

Sums up the input items like a pivot table (runs once with all of them). Group by: fields, comma separated (none: one group). Measures: a field and what to work out (count, countUnique, sum, average, min, max, concatenate with a separator, append into a list) under a name. One item per group: { <group fields>, <names> }.

Compare

data/compare · icon git-compare-arrows

Compares two lists: input A and input B, matched by key fields (comma separated). Each item leaves through same, different, onlyA or onlyB. Fields to leave out don't count as a difference. When they differ it sends both ({ a, b }), A's or B's.

Crypto

data/crypto · icon fingerprint

hash (md5, sha1, sha256, sha384, sha512), hmac with a secret, base64Encode, base64Decode, uuid, or random bytes (hex or base64). The result goes into the item under Name in the output (default result).

HTML

data/html · icon code-xml

Reads values out of HTML with CSS selectors. Each value: a name, a selector, what to read (its text, its HTML, an attribute) and whether to take every match as a list. Tidy whitespace (on) collapses spaces and line breaks.

Convert

data/convert · icon arrow-right-left

Runs once. jsonToXml (with a root element), xmlToJson (attributes as @_name), csvToItems (one item per row; the first row names the columns; quoted cells work), itemsToCsv (the input items), queryToObject, objectToQuery, markdownToHtml, htmlToText. The result goes under Name in the output; CSV to items sends the rows as items.

RSS

data/rss · icon rss

Reads an RSS or Atom feed (public addresses): one item per entry, { title, link, date, text, author, image }, up to Entries at most (20). No entries: the empty dot.

Store

data/store · icon database

A value kept across runs: get, set, increment (by N), append to a list, remove from a list, delete, or list the keys (with a prefix). Kept for: this flow, this campaign's group (a Studio run: its flow), or the whole workspace. Test runs keep their own values. Each write is journaled, so puts the old value back. Output: the item with { key, value } (list: keys).

Code

data/code · icon square-code · plan feature code

Your JavaScript, in the worker. Once per item: item and index, return that item's output (an object, a list of objects, or null to drop it). Once with all items: items, return the output list. ctx is the whole (files, API, log, sleep). await works. Python isn't available.

Next post

data/post · icon file-stack

Hands out the next post of a post set, or files of a Drive folder, for this campaign

From a post set: pick the set with an option of kind Post set ({{ option.post.dataset }}), like accounts. Drafts (from Generate with AI) and posts whose media was deleted from the Drive are skipped (the post is marked in ). From a Drive folder: count files of the folder (its own files, not its subfolders') become the media of one post, with no text.

Order: shuffle (at random), by name (A→Z or Z→A, numbers in order) or by date added. Repeat: unique hands out each post once per campaign, then the empty dot (the last one also sends a notification); rotate hands out the least used next, so it goes round forever. What a campaign took is kept per campaign (Studio runs have their own count, test runs too), so one set can feed several campaigns.

media holds the Drive file ids, ready for a post node's Media (𝕏, Threads, Facebook); file has their names, types and sizes; left is what unique still has.

Fields

Output dots

• next — Next
• empty — Used up

Output shape

Later nodes read it as {{ nodes.<id>.output… }}.

{
  "key": "string",
  "name": "string",
  "text": "string",
  "media": [
    "string"
  ],
  "file": [
    {
      "id": "string",
      "name": "string",
      "mime": "string",
      "size": "number"
    }
  ],
  "left": "number"
}

Default settings

timeout 1 minutes; the rest are the .