10 Advanced
10.1 Memory
A good start when programming efficiently is to know how much memory different data types and operations require. It is implementation-dependent how much memory the Erlang data types and other items consume, but the following table shows some figures for the erts-8.0 system in OTP 19.0.
The unit of measurement is memory words. There exists both a 32-bit and a 64-bit implementation. A word is therefore 4 bytes or 8 bytes, respectively.
| Data Type | Memory Size |
| Small integer | 1 word. On 32-bit architectures: -134217729 < i < 134217728 (28 bits). On 64-bit architectures: -576460752303423489 < i < 576460752303423488 (60 bits). |
| Large integer | 3..N words. |
| Atom | 1 word. An atom refers into an atom table, which also consumes memory. The atom text is stored once for each unique atom in this table. The atom table is not garbage-collected. |
| Float | On 32-bit architectures: 4 words. On 64-bit architectures: 3 words. |
| Binary | 3..6 words + data (can be shared). |
| List | 1 word + 1 word per element + the size of each element. |
| String (is the same as a list of integers) | 1 word + 2 words per character. |
| Tuple | 2 words + the size of each element. |
| Small Map | 5 words + the size of all keys and values. |
| Large Map (> 32 keys) |
N x F words + the size of all keys and values. N is the number of keys in the Map. F is a sparsity factor that can vary between 1.6 and 1.8 due to the probabilistic nature of the internal HAMT data structure. |
| Pid | 1 word for a process identifier from the current local node
+ 5 words for a process identifier from another node. A process identifier refers into a process table and a node table, which also consumes memory. |
| Port | 1 word for a port identifier from the current local node
+ 5 words for a port identifier from another node. A port identifier refers into a port table and a node table, which also consumes memory. |
| Reference | On 32-bit architectures: 5 words for a reference from the
current local node + 7 words for a reference from another
node. On 64-bit architectures: 4 words for a reference from the current local node + 6 words for a reference from another node. A reference refers into a node table, which also consumes memory. |
| Fun | 9..13 words + the size of environment. A fun refers into a fun table, which also consumes memory. |
| Ets table | Initially 768 words + the size of each element (6 words + the size of Erlang data). The table grows when necessary. |
| Erlang process | 338 words when spawned, including a heap of 233 words. |
Table 10.1: Memory Size of Different Data Types
10.2 System Limits
The Erlang language specification puts no limits on the number of processes, length of atoms, and so on. However, for performance and memory saving reasons, there will always be limits in a practical implementation of the Erlang language and execution environment.
| Processes | The maximum number of simultaneously alive Erlang processes is by default 262,144. This limit can be configured at startup. For more information, see the +P command-line flag in the erl(1) manual page in ERTS. |
| Known nodes | A remote node Y must be known to node X if there exists any pids, ports, references, or funs (Erlang data types) from Y on X, or if X and Y are connected. The maximum number of remote nodes simultaneously/ever known to a node is limited by the maximum number of atoms available for node names. All data concerning remote nodes, except for the node name atom, are garbage-collected. |
| Connected nodes | The maximum number of simultaneously connected nodes is limited by either the maximum number of simultaneously known remote nodes, the maximum number of (Erlang) ports available, or the maximum number of sockets available. |
| Characters in an atom | 255. |
| Atoms | By default, the maximum number of atoms is 1,048,576. This limit can be raised or lowered using the +t option. |
| Ets tables | Default is 1400. It can be changed with the environment variable ERL_MAX_ETS_TABLES. |
| Elements in a tuple | The maximum number of elements in a tuple is 67,108,863 (26-bit unsigned integer). Clearly, other factors such as the available memory can make it difficult to create a tuple of that size. |
| Size of binary | In the 32-bit implementation of Erlang, 536,870,911
bytes is the largest binary that can be constructed or matched
using the bit syntax. In the 64-bit implementation, the maximum
size is 2,305,843,009,213,693,951 bytes. If the limit is
exceeded, bit syntax construction fails with a
system_limit exception, while any attempt to match a
binary that is too large fails. This limit is enforced starting
in R11B-4. In earlier Erlang/OTP releases, operations on too large binaries in general either fail or give incorrect results. In future releases, other operations that create binaries (such as list_to_binary/1) will probably also enforce the same limit. |
| Total amount of data allocated by an Erlang node | The Erlang runtime system can use the complete 32-bit (or 64-bit) address space, but the operating system often limits a single process to use less than that. |
| Length of a node name | An Erlang node name has the form host@shortname or host@longname. The node name is used as an atom within the system, so the maximum size of 255 holds also for the node name. |
| Open ports | The maximum number of simultaneously open Erlang ports is often by default 16,384. This limit can be configured at startup. For more information, see the +Q command-line flag in the erl(1) manual page in ERTS. |
| Open files and sockets | The maximum number of simultaneously open files and sockets depends on the maximum number of Erlang ports available, as well as on operating system-specific settings and limits. |
| Number of arguments to a function or fun | 255 |
| Unique References on a Runtime System Instance | Each scheduler thread has its own set of references, and all other threads have a shared set of references. Each set of references consist of 2⁶⁴ - 1 unique references. That is the total amount of unique references that can be produced on a runtime system instance is (NoSchedulers + 1) * (2⁶⁴ - 1). If a scheduler thread create a new reference each nano second, references will at earliest be reused after more than 584 years. That is, for the foreseeable future they are unique enough. |
| Unique Integers on a Runtime System Instance |
There are two types of unique integers both created using the
erlang:unique_integer()
BIF:
1. Unique integers created with the monotonic modifier consist of a set of 2⁶⁴ - 1 unique integers. 2. Unique integers created without the monotonic modifier consist of a set of 2⁶⁴ - 1 unique integers per scheduler thread and a set of 2⁶⁴ - 1 unique integers shared by other threads. That is, the total amount of unique integers without the monotonic modifier is (NoSchedulers + 1) × (2⁶⁴ - 1). If a unique integer is created each nano second, unique integers will at earliest be reused after more than 584 years. That is, for the foreseeable future they are unique enough. |
Table 10.2: System Limits