1  Inets Release Notes

1 Inets Release Notes

  • Adjust uri_string:normalize behavior for URIs with undefined port (URI string with a port colon but no port value or URI map with port => undefined).

    Remove redundant normalization from http_request module.

    Before this change, normalize would not remove port subcomponent in such cases and could for example return "http://localhost:" URI.

    *** POTENTIAL INCOMPATIBILITY ***

    Own Id: OTP-17627

  • Fixed typo in Reason term returned from httpc_handler:handle_http_body.

    After this change, could_not_establish_ssl_tunnel atom is returned within Reason term.

    *** POTENTIAL INCOMPATIBILITY ***

    Own Id: OTP-17889

  • This change removes deprecated functions: http_uri:parse/1, http_uri:parse/2 and http_uri:scheme_defaults/0.

    This change delays until OTP-26 removal of deprecated functions: http_uri:encode/1 and http_uri:decode/1.

    This change marks httpd_util:decode_hex/1 and httpd_util:encode_hex/1 as deprecated.

    *** POTENTIAL INCOMPATIBILITY ***

    Own Id: OTP-17866

  • The compilation time is no longer recorded in BEAM files. There remained several undocumented functions that attempted to retrieve compilation times. Those have now been removed.

    Own Id: OTP-17962

  • Documentation fix for inets:services_info/0, which now describes that Info might be a Reason term() in case when {error, Reason} is returned as service info.

    Own Id: OTP-17931 Aux Id: ERIERL-761

  • Avoid intermediate ungraceful shutdown of the HTTP server.

    Own Id: OTP-17922 Aux Id: ERIERL-743

  • Correct HTTP server URI handling to fully rely on uri_string. The server could mistreat some URI paths that in turn could result in incorrect responses being generated.

    Own Id: OTP-17818 Aux Id: ERIERL-731

  • Extend header values to httpc:request/5 to allow binary() as well. Make error detection of invalid arguments to httpc:request/5 be more precise so an error is returned in more cases instead of causing a hang or function_clause. Be more precise in documentation regarding the types of arguments being accepted.

    Own Id: OTP-17579 Aux Id: GH-5074

  • Before this change hrefs in dir listing page contained percentage encoded forward slashes which did not work properly with httpd.

    Own Id: OTP-17383 Aux Id: GH-4677

  • Restored HTTP headers handling in inets/mod_esi.

    Own Id: OTP-17600

  • inets/httpd dir listing icons and other improvements

    Own Id: OTP-17624 Aux Id: GH-4855

  • httpc: Improve performance by removing redundant URI handling

    Own Id: OTP-17460

  • Improved user input handling in inets/mod_esi preventing unnecessary atom creation.

    Own Id: OTP-17490

  • Drop all support for ftp and tftp in inets code.

    Own Id: OTP-16722

  • Deprecate following functions in httpd_util module: flatlength/1, lhexlist_to_integer/1, integer_to_hexlist/1, strip/1, and suffix/1.

    Own Id: OTP-16723

  • Remove support of HTTP 0.9 in httpd.

    Own Id: OTP-16724

  • Remove support of HTTP 0.9 in httpc.

    Own Id: OTP-16725

  • Fixed warnings in code matching on underscore prefixed variables.

    Own Id: OTP-17385 Aux Id: OTP-17123

  • Restored HTTP headers handling in inets/mod_esi.

    Own Id: OTP-17600

  • Improved user input handling in inets/mod_esi preventing unnecessary atom creation.

    Own Id: OTP-17490

  • Solves CVE-2021-27563, that is make sure no form of relative path can be used to go outside webservers directory.

    Own Id: OTP-17205 Aux Id: ERIERL-608

  • Make sure HEAD requests rejects directory links

    Own Id: OTP-17220

  • Fix an issue about HTML-escaped filename in inets.

    Own Id: OTP-16873 Aux Id: ERL-330

  • Clarify the handling of percent encoded characters in http client.

    Own Id: OTP-16650 Aux Id: ERL-1215, PR-2629

  • fix crash for undefined port in uri.

    Own Id: OTP-16663 Aux Id: ERL-1241

  • Avoid timing issue when setting active once on a socket that is being closed by the peer.

    Own Id: OTP-16735 Aux Id: OTP-16697, ERIERL-496

  • Handle message body of response with 1XX status code as next http message.

    Own Id: OTP-16746 Aux Id: ERL-1268

  • Fix a crash in http server when setopts is called on a socket closed by the peer.

    Own Id: OTP-16775 Aux Id: ERIERL-519

  • A vulnerability in the httpd module (inets application) regarding directory traversal that was introduced in OTP 22.3.1 and corrected in OTP 22.3.4.6. It was also introduced in OTP 23.0 and corrected in OTP 23.1 The vulnerability is registered as CVE-2020-25623

    The vulnerability is only exposed if the http server (httpd) in the inets application is used. The vulnerability makes it possible to read arbitrary files which the Erlang system has read access to with for example a specially prepared http request.

    Own Id: OTP-16790 Aux Id: ERIERL-522

  • Add support of PATCH method in mod_esi.

    Own Id: OTP-16591 Aux Id: ERIERL-484

  • Remove support for deprecated functionality. Support for mod_esi eval scheme, mod_htacess, mod_browser, apache config files and deprecated httpd_conf functions are dropped. Module http_uri is deprecated.

    Own Id: OTP-16252

  • Refactored the internal handling of deprecated and removed functions.

    Own Id: OTP-16469

  • Corrected an error regarding decode of percent encoded URLs introduced in inets-7.1.3.

    Own Id: OTP-16790 Aux Id: ERIERL-522

  • Fix a crash in http server when setopts is called on a socket closed by the peer.

    Own Id: OTP-16775 Aux Id: ERIERL-519

  • Avoid timing issue when setting active once on a socket that is being closed by the peer.

    Own Id: OTP-16735 Aux Id: OTP-16697, ERIERL-496

  • Remove use of http_uri and mod_esi eval API.

    This is a backport from OTP 23 that improves the check of URIs to ensure that invalid URIs does not cause vulnerabilities. This will render the deprecated mod_esi eval API unusable as it used URI that does not conform to valid URI syntax.

    *** POTENTIAL INCOMPATIBILITY ***

    Own Id: OTP-16556

  • Inets will honor that valid HTTP headers can not have white space between field-name and the colon.

    Own Id: OTP-16169 Aux Id: ERL-1053

  • Changed error propagation in httpc:request/1 to return expected error tuple instead of crashing.

    Own Id: OTP-16290 Aux Id: PR-2437, ERL-1083

  • Fix handling of HEAD request with chunked transfer-encoding (httpc).

    Own Id: OTP-16300 Aux Id: ERL-1090

  • Add HTTP server error logging vi logger

    Own Id: OTP-16019

  • httpd - Accept single LF as line terminator

    Own Id: OTP-15893 Aux Id: PR-2206

  • mod_esi will now always propagate the actual HTTP status code that it answered with, to later mod-modules, and not in some cases hardcode 200.

    Own Id: OTP-16049 Aux Id: ERIERL-395

  • Fix a regression in http client that causes a crash when request URI has no scheme.

    Own Id: OTP-15930 Aux Id: ERL-969

  • All incorrect (that is, all) uses of "can not" has been corrected to "cannot" in source code comments, documentation, examples, and so on.

    Own Id: OTP-14282 Aux Id: PR-1891

  • Add HTTP server error logging vi logger

    Own Id: OTP-16019

  • mod_esi will now always propagate the actual HTTP status code that it answered with, to later mod-modules, and not in some cases hardcode 200.

    Own Id: OTP-16049 Aux Id: ERIERL-395

  • Fix the internal handling of the option erl_script_timeout in httpd. If explicit erl_script_timeout value was supplied in seconds it was not correctly converted to millisecond units for internal usage.

    This change fixes the handling of erl_script_timeout in all possible configuration scenarios.

    Own Id: OTP-15769 Aux Id: ERIERL-345

  • Fix the internal handling of the option erl_script_timeout in httpd. When httpd was started with explicit erl_script_timeout, the value of the option was converted to milliseconds before storage. Subsequent calls to httpd:info/1 returned the input value multiplied by 1000.

    This change fixes the handing of erl_script_timeout by storing the timeout in seconds and converting to milliseconds before usage.

    Own Id: OTP-15669 Aux Id: ERIERL-321

  • Enhance documentation

    Own Id: OTP-15508 Aux Id: ERL-816

  • Fixed bug that causes a crash in http client when using hostnames (e.g. localhost) with the the option ipv6_host_with_brackets set to true.

    This change also fixes a regression: httpc:request fails with connection error (nxdomain) if option ipv6_host_with_brackets set to true and host component of the URI is an IPv6 address.

    Own Id: OTP-15554 Aux Id: ERIERL-289

  • Make sure ipv6 addresses with brackets in URIs are converted correctly before passing to lower level functions like gen_tcp and ssl functions. Could cause connection to fail.

    Own Id: OTP-15544 Aux Id: ERIERL-289

  • Fixed http client to not send 'content-length' header in chunked encoded requests.

    Own Id: OTP-15338 Aux Id: ERL-733

  • Fixed http client to not drop explicit 'Content-Type' header in requests without a body such as requests with the 'Content-Type' of application/x-www-form-urlencoded.

    Own Id: OTP-15339 Aux Id: ERL-736

  • Enhance error handling, that is mod_get will return 403 if a path is a directory and not a file.

    Own Id: OTP-15192

  • Do not use chunked-encoding with 1xx, 204 and 304 responses when using mod_esi. Old behavior was not compliant with HTTP/1.1 RFC and could cause clients to hang when they received 1xx, 204 or 304 responses that included an empty chunked-encoded body.

    Own Id: OTP-15241

  • Add robust handling of chunked-encoded HTTP responses with an empty body (1xx, 204, 304). Old behavior could cause the client to hang when connecting to a faulty server implementation.

    Own Id: OTP-15242

  • Change status code for no mod found to handle request to 501

    Own Id: OTP-15215

  • Fixed HTTP content injection bug in httpc (ERL-456).

    Own Id: OTP-14726

  • Fixed support for URI-references in HTTP 'Location' header (ERL-333).

    Own Id: OTP-14729

  • Fix broken 'Content-Type' handling in httpc (ERL-536).

    Own Id: OTP-15006

  • Fix handling of relative paths in the script_alias property of httpd (ERL-574).

    Own Id: OTP-15021

  • Fix httpd:reload_config/2 with path() as the first argument (ERL-578).

    Own Id: OTP-15025

  • Improved gracefulness.

    Own Id: OTP-15042

  • Split inets and create separate ftp and tftp apps.

    Own Id: OTP-14113

  • Do not use chunked-encoding with 1xx, 204 and 304 responses when using mod_esi. Old behavior was not compliant with HTTP/1.1 RFC and could cause clients to hang when they received 1xx, 204 or 304 responses that included an empty chunked-encoded body.

    Own Id: OTP-15241

  • Add robust handling of chunked-encoded HTTP responses with an empty body (1xx, 204, 304). Old behavior could cause the client to hang when connecting to a faulty server implementation.

    Own Id: OTP-15242

  • Change status code for no mod found to handle request to 501

    Own Id: OTP-15215

  • Enhance error handling, that is mod_get will return 403 if a path is a directory and not a file.

    Own Id: OTP-15192

  • Options added for setting low-level properties on the underlying TCP connections. The options are: sock_ctrl, sock_data_act and sock_data_pass. See the manual for details.

    Own Id: OTP-15120 Aux Id: ERIERL-192

  • inets: httpd - Gracefully handle bad headers

    The option max_headers operated on the individual header length instead of the total length of all headers. Also headers with empty keys are now discarded.

    Own Id: OTP-15092

  • Fix broken options handling in httpc (ERL-441).

    Own Id: OTP-15007

  • httpc_manager crashes when a long running request is sent on a persistent HTTP connection (keep-alive). Fixed httpc_manager to use proper timeouts on keep-alive connections.

    Own Id: OTP-14908

  • Add support for unix domain sockets in the http client.

    Own Id: OTP-14854

  • CGI environment variable CONTENT_LENGTH shall be a string

    Own Id: OTP-14679

  • In relaxed mode disregard Content-Length header if there is also a Transfer-Encoding header.

    Own Id: OTP-14727

  • Eliminated race condition, that could cause http request to sporadically fail to complete successfully, when keep-alive connections are used.

    Own Id: OTP-14783

  • Correct the handling of location headers so that the status code is not hard coded. This should have been fixed by commit 2cc5ba70cbbc6b3ace81a2a0324417c3b65265bb but unfortunately was broken during a code refactoring and unnoticed due to a faulty placed test case.

    Own Id: OTP-14761

  • Fix broken handling of POST requests

    New chunk mechanism of body data in POST requests added in 5d01c70ca399edf28e99dc760506329689fab6ba broke handling of POST body data not using the new mechanism.

    Own Id: OTP-14656

  • Make sure ints:stop/2 of the service httpd is synchronous

    Own Id: OTP-14696

  • Honor status code returned by ESI script and modernize "location" header handling.

    Own Id: OTP-14716

  • Make sure mod_log uses the correct status code

    Own Id: OTP-14510

  • Correct behaviour of mod_disk_log to proparly handle repair options

    Own Id: OTP-14530

  • http_uri aligned to follow RFC 3986 and not convert "+" to space when decoding URIs.

    Own Id: OTP-14573

  • Added new option max_client_body_chunk to httpd server to allow chunked delivery of PUT and POST data to mod_esi callback. Note, new mod_esi callback implementation is required.

    Also correct value provided by server_name environment variable

    Own Id: OTP-14450

  • httpd_util:rfc1123_date/1 gracefully handle invalid DST dates by returning the original time in the expected rfc1123 format.

    Own Id: OTP-14394

  • Add unicode binary support to http_uri functions

    Own Id: OTP-14404

  • httpc - Change timeout handling so the redirects cause a new timer to be set. This means that a simple redirected request could return after 2*timeout milliseconds.

    Own Id: OTP-14429

  • The close of a chunked file reception crashed in a certain timing sequence.

    Own Id: OTP-14391 Aux Id: seq13306

  • Added missing release note for inets-6.3.7

    Own Id: OTP-14383

  • Fixed a bug in ftp that made further operations after a recv_chunk operation impossible.

    Own Id: OTP-14242

  • Make default port, 80 and 443, implicit in automatic redirection.

    Own Id: OTP-14301

  • Chunk size decoding could fail. The symptom was that chunk decoding sometimes failed depending on timing of the received stream. If chunk size was split into two different packets decoding would fail.

    Own Id: OTP-13571 Aux Id: ERL-116

  • Prevent httpc user process to hang if httpc_handler process terminates unexpectedly

    Own Id: OTP-14091

  • Correct Host header, to include port number, when redirecting requests.

    Own Id: OTP-14097

  • Shutdown gracefully on connection or TLS handshake errors

    Own Id: OTP-14173 Aux Id: seq13262

  • Correct mistakes in ftp client introduced in inets-6.3.4

    Own Id: OTP-14203 Aux Id: OTP-13982

  • Fixes a bug that makes the ftp client end up in bad state if there is a multi line response from the server and the response number is in the message being sent.

    Own Id: OTP-13960 Aux Id: PR1196

  • The ftp client could stop consuming messages when the multiline response handling was corrected.

    Own Id: OTP-13967

  • Fix keep-alive https through proxy connections so that all requests, following the first one, will run as expected instead of failing.

    Own Id: OTP-14041

  • Fix bug from commit fdfda2fab0921d409789174556582db28141448e that could make listing of group members in mod_auth callbacks fail.

    Own Id: OTP-14082

  • Update behavior of httpc:request to match RFC-7231

    Own Id: OTP-13902

  • Fixed dialyzer warnings as well as some white-space issues. Thanks to Kostis.

    Own Id: OTP-13982 Aux Id: PR-1207

  • The legacy option 'inet6fb4' for inets had stopped working. This bug has now been corrected. Fix by Edwin Fine in bugs.erlang.org ERL-200 and Github PR#1132.

    Own Id: OTP-13776 Aux Id: ERL-200 PR-1132

  • PUT and DELETE support has been added to mod_esi

    Own Id: OTP-13688 Aux Id: seq13149

  • A debug message was accidentally left enabled in the ftp client.

    Own Id: OTP-13712 Aux Id: seq13143

  • Ftp client fixes: 1) Corrected a bug that the ftp client gen_server crashed if the listening data socket was closed.

    2) Corrections of ftp client error codes so they are as defined in the reference manual

    Own Id: OTP-13644

  • Remove usage of erlang:now().

    Own Id: OTP-12441

  • Add handling of DELETE Body to http client.

    Own Id: OTP-13383 Aux Id: PR-972

  • Removed references to mod_include and webtool from examples and tests.

    Own Id: OTP-13445 Aux Id: PR-988

  • Remove module inets_regexp. Module re should be used instead.

    *** POTENTIAL INCOMPATIBILITY ***

    Own Id: OTP-13561

  • Handle multiple \t in mime types file

    Own Id: OTP-13663 Aux Id: seq13132

  • Put back unused module inets_regexp and remove it in OTP 19 instead as it is an incompatibility, although it is an undocumented module and should not affect other applications.

    Own Id: OTP-13533

  • Add environment information item peer_cert to mod_esi

    Own Id: OTP-13510

  • Mend ipv6_host_with_brackets option in httpc

    Own Id: OTP-13417

  • The TFTP client/server has been fixed to allow file sizes larger than 32MB block by allowing the 16 bit block counter to wrap. Since this is a commonly accepted behavior we regard it as a bug fix.

    Own Id: OTP-13403

  • Handle HTTP PATCH method in client.

    Own Id: OTP-13286

  • Expected termination should not be logged as an application error.

    Own Id: OTP-13389

  • Mend ipv6_host_with_brackets option in httpc

    Own Id: OTP-13417

  • mod_alias now traverses all aliases picking the longest match and not the first match.

    Own Id: OTP-13248

  • Replace obs-folds with spaces instead of failing

    Own Id: OTP-13069

  • Add validation fun for URI scheme to http_uri API

    Own Id: OTP-13071

  • Handle stream bodies as documented.

    Own Id: OTP-13093

  • Correct error handling of mod_esi generated chunks. Send warning headers in chunk trailers instead of generating an unexpected additional 500 request response, when problems, such as a timeout occurs.

    Own Id: OTP-13110

  • HTTP client terminates gracefully when an invalid chunked length header is encountered.

    Own Id: OTP-13117

  • Add default for SNI (Server Name Indication) when running https using the inets HTTP-client.

    Own Id: OTP-12985

  • Be forgiving to chunked sizes that have trailing whitespaces as prior implementation was. Also some legacy embedded devices does actually have trailing whitespaces even though this in not according to the spec.

    Own Id: OTP-13116

  • Improved error handling and gracfully termination when an invalid chunked length header is encountered.

    Own Id: OTP-13061

  • Add possibility to set socket options, such as nodelay, for httpd. Also phase out legacy option value inet6bf4 for the ipfamily option. This value will be translated to the value inet.

    *** POTENTIAL INCOMPATIBILITY ***

    Own Id: OTP-13062

  • Avoid crash in mod_auth_server and mod_security_server due to using an atom instead of a string when creating a name.

    Own Id: OTP-13022

  • Add function response_default_headers/0 to httpd customize API, to allow user to specify default values for HTTP response headers.

    Own Id: OTP-13013

  • Fix broken socket feature, that is on Linux systems a socket may be opened before starting Erlang and then passed to Erlang's httpd daemon. This is useful as the wrap program can open a privileged port and Erlang does not have to be run as root.

    Own Id: OTP-12875 Aux Id: seq12878

  • Fix broken socket feature, that is on Linux systems a socket may be opened before starting Erlang and then passed to Erlangs tftp daemon. This is useful as the wrap program can open a privileged port and Erlang does not have to be run as root.

    Own Id: OTP-12898 Aux Id: seq12900

  • httpc_handler should react properly to cancel requests even when the request to be canceled was already finished but httpc_manager did not get notified about that yet.

    Own Id: OTP-12922

  • Added format_status function to httpd process to avoid sensitive information to be printed in supervisor logs.

    Own Id: OTP-12976

  • Return meaningful error reason disregarding whether a http proxy is used or not.

    Own Id: OTP-12984

  • Fix race condition in httpc. If the socket is closed by the peer do not try to close it again.

    Own Id: OTP-11845

  • Avoid process leak by gracefully terminating httpc request handler process when send operation fails.

    Own Id: OTP-12362

  • Reject messages with a Content-Length less than 0

    Own Id: OTP-12739 Aux Id: seq12860

  • Let gen_tcp:controlling_process/2 and inet_sctp:connect/[45] propagate prim_inet:setopt/3 errors instead of having them generate badmatch exceptions.

    Own Id: OTP-12798

  • Remove Server Side Include support from inets, as this is an old technique that has security issues and was not well tested.

    *** POTENTIAL INCOMPATIBILITY ***

    Own Id: OTP-12156

  • New value in server_tokens config for limiting banner grabbing attempts.

    By setting {server_tokens, none} in ServiceConfig for inets:start(httpd, ServiceConfig), the "Server:" header will not be set in messages from the server.

    Own Id: OTP-12661 Aux Id: seq12840

  • To enable the HTTP server to run in a virtualized environment, where there can be more that one server that has the same ip-address and port, we add a new option profile.

    Own Id: OTP-12674

  • httpc: Fix implementation of graceful shudown to work as intended for keep alive connections not using pipelining.

    Own Id: OTP-12803

  • Correct handling of proxy options when using persistent connections.

    Own Id: OTP-12822

  • Add behaviour with optional callbacks to customize the inets HTTP server.

    Own Id: OTP-12776

  • Reject messages with a Content-Length less than 0

    Own Id: OTP-12739 Aux Id: seq12860

  • New value in server_tokens config for limiting banner grabbing attempts.

    By setting {server_tokens, none} in ServiceConfig for inets:start(httpd, ServiceConfig), the "Server:" header will not be set in messages from the server.

    Own Id: OTP-12661 Aux Id: seq12840

  • inets: parse correctly 'Set-Cookie' header with empty value

    httpc_cookie should parse cookies with empty values and no attributes set in the 'Set-Cookie' headers.

    Own Id: OTP-12455

  • Add parsing of URI fragments to http_uri:parse

    This fixes a bug in httpc where redirection URIs could lead to bad requests if they contained fragments.

    Own Id: OTP-12398

  • httpc: http client now ignores invalid set-cookie headers

    Own Id: OTP-12430

  • mod_alias now handles https-URIs properly

    Consistent view of configuration parameter keep_alive_timeout, should be presented in the httpd:info/[1,2] function in the same unit as it is inputted.

    Own Id: OTP-12436 Aux Id: seq12786

  • Gracefully handle invalid content-length headers instead of crashing in list_to_integer.

    Own Id: OTP-12429

  • Fixed a spelling mistake in httpc documentation.

    Own Id: OTP-12221

  • Add option {ftp_extension, boolean} to enable use of extended commands EPSV and EPRT, as specified in RFC 2428, for IPv4 instead of using the legacy commands. Ipv6 cannot be supported without the extended commands.

    Own Id: OTP-12255

  • Fix some spelling mistakes in documentation

    Own Id: OTP-12152

  • httpd: Separate timeout for TLS/SSL handshake from keepalive timeout

    Own Id: OTP-12013

  • Warning: this is experimental and may disappear or change without previous warning.

    Experimental support for running Quickcheck and PropEr tests from common_test suites is added to common_test. See the reference manual for the new module ct_property_testing.

    Experimental property tests are added under lib/{inet,ssh}/test/property_test. They can be run directly or from the commont_test suites inet/ftp_property_test_SUITE.erl and ssh/test/ssh_property_test_SUITE.erl.

    See the code in the test directories and the man page for details.

    (Thanks to Tuncer Ayaz for a patch adding Triq)

    Own Id: OTP-12119

  • httpc: Fix streaming bugs when handling small responses

    Own Id: OTP-11992

  • Correct distirbing mode for httpd:reload_config/2

    Own Id: OTP-11914

  • Improved handling of invalid strings in the HTTP request line.

    Impact: May improve memory consumption

    Own Id: OTP-11925 Aux Id: Sequence 12601

  • Fixed a spelling mistake in httpc doc (Thanks to Wasif Riaz Malik)

    Own Id: OTP-11538

  • Application upgrade (appup) files are corrected for the following applications:

    asn1, common_test, compiler, crypto, debugger, dialyzer, edoc, eldap, erl_docgen, et, eunit, gs, hipe, inets, observer, odbc, os_mon, otp_mibs, parsetools, percept, public_key, reltool, runtime_tools, ssh, syntax_tools, test_server, tools, typer, webtool, wx, xmerl

    A new test utility for testing appup files is added to test_server. This is now used by most applications in OTP.

    (Thanks to Tobias Schlager)

    Own Id: OTP-11744

  • ftp now sanitize file name, user name and passwords from <CR> and <LF> tags (Thanks to Sergei Golovan)

    Own Id: OTP-11750

  • Corrected error handling in the HTTP client, making it behave more graceful.

    Thanks to Kirilll Zaborsky

    Own Id: OTP-11794

  • Support identity transfer-encoding in httpc.

    Thanks to Anthony Ramine

    Own Id: OTP-11802

  • Ignore empty Set-Cookie headers to increase interoperability with servers that violate the RFC.

    Thanks to Kirilll Zaborsky

    Own Id: OTP-11803

  • The commit 6189bc07 "inets: httpc improve pipelining" has been reverted, as it turned out to break things rather than improve pipelining utilization. It is instead up to the user to configure httpc and use it wisely to be able to get the most out of pipelining.

    Own Id: OTP-11756

  • Handle all response codes in httpd_util:message/3

    Own Id: OTP-11838

  • Mend max_clients check that was broken and avoid too extensive logging that could cause memory problems.

    Own Id: OTP-11557 Aux Id: seq12478

  • Fix httpd config option 'script_timeout' and fixed httpd config option 'keep_alive_timeout'. Thanks to Johannes Weissl.

    Own Id: OTP-11276

  • Make httpc:request_cancel/[1,2] asynchronous. Previously these functions tried to guarantee request answer would not reach the client, which only worked for some of the use cases. Now these functions are totally asynchronous which makes it the clients responsibility to disregard possible answers to canceled requests.

    Also pipelining implementation has been changed to improve the utilization factor. Further investigation of possible enhancements in this area are planned for later.

    *** POTENTIAL INCOMPATIBILITY ***

    Own Id: OTP-11312

  • [httpd] Add handling of new response for mod_head (otherwise causing case_clause crash). Also updated logging: Removed logging for keep-alive connections timeout (this is a normal occurrence and not an error) and some access-log body size corrections.

    Own Id: OTP-11328

  • The ftp client now supports ftp over tls (ftps).

    Own Id: OTP-11037

  • httpc: Allow content body in DELETE requests. Thanks to James Wheare.

    Own Id: OTP-11190

  • Add missing brackets to report formatting on ftp_progress process exit. Thanks to Artur Wilniewczyc.

    Own Id: OTP-11202

  • Fix some errors in the inets documentation. Thanks to Johannes Weissl.

    Own Id: OTP-11210

  • Fix various typos in httpd, inets. Thanks to Tomohiko Aono.

    Own Id: OTP-11226

  • Fix httpd config option 'erl_script_nocache'. Thanks to Johannes Weissl.

    Own Id: OTP-11260

  • Reverted incorrect commit that broke cookie handling when using httpc-profiles.

    Own Id: OTP-10956

  • Fix http_request:http_headers/1 to send content-length when length is zero. Thanks to CA Meijer.

    Own Id: OTP-10934

  • Integrate elliptic curve contribution from Andreas Schultz

    In order to be able to support elliptic curve cipher suites in SSL/TLS, additions to handle elliptic curve infrastructure has been added to public_key and crypto.

    This also has resulted in a rewrite of the crypto API to gain consistency and remove unnecessary overhead. All OTP applications using crypto has been updated to use the new API.

    Impact: Elliptic curve cryptography (ECC) offers equivalent security with smaller key sizes than other public key algorithms. Smaller key sizes result in savings for power, memory, bandwidth, and computational cost that make ECC especially attractive for constrained environments.

    Own Id: OTP-11009

  • Fix {stream, {self, once}} in httpc to work as expected. Thanks to Masatake Daimon

    Own Id: OTP-11122

  • httpd: The modules option now defaults to the documented value.

    Own Id: OTP-10844

  • httpc: Fixed persistent connection implementation that was broken by a patch to R13. The patch made persistent connections behaved the same way as pipelining.

    Own Id: OTP-10845

  • httpd: Simplified configuration of ssl in httpd, this also enables all ssl options to be configured. The old and limited way is no longer documented but will be supported for backwards comatibility for some time.

    Own Id: OTP-10846

  • Handle correctly the "No files found or file unavailable" error code. Thanks to Serge Aleynikov

    Own Id: OTP-10886

  • httpc: The HTTP client now supports HTTPS through proxies

    Own Id: OTP-10256 Aux Id: kunagi-2 [ce2e800e-c99f-4050-a1c4-f47023d9c7aa-1]

  • Some examples overflowing the width of PDF pages have been corrected.

    Own Id: OTP-10665

  • Fix autoredirect for POST requests responding 303. Thanks to Hans Svensson.

    Own Id: OTP-10765

  • Make log_alert configurable as option in ssl, SSLLogLevel added as option to inets conf file

    Own Id: OTP-11259

  • Fixed obsolete error report in inets.

    Own Id: OTP-11185 Aux Id: seq12357

  • Minimum bytes per second

    New option to http server, {minimum_bytes_per_second, integer()}, for a connection, if it is not reached the socket will close for that specific connection. Can be used to prevent hanging requests from faulty clients.

    Own Id: OTP-10392

  • Better handling of errorI(s) during update of the session database.

    Also added and updated some debugging functions which_sessions/[0,1] and info/0.

    Own Id: OTP-10093

    Aux Id: Seq 12062

  • Removed R14B compatible version of (inets-service and tftp) behaviour definition.

    Own Id: OTP-10095

  • [httpc] Documentation of KeepAlive and Pipeline timeout options have been improved.

    Own Id: OTP-10114

  • [httpc] Cancel request does not work due to incorrect handler table creation (wrong keypos).

    Vyacheslav Vorobyov

    Own Id: OTP-10092

-

  • [httpd] Make the server header configurable with new config option server_tokens. The value of the server header, which was previously hard-coded (at compile time), is now possible to manipulate through the means of the server_tokens config option.

    Own Id: OTP-9805

  • Improve inets support for inets as an included application.

    inets_app calls supervisor:start_link/3 directly rather than calling the root supervisor function inets_sup:start_link/0. This precludes using included_applications to start inets without having a wrapper function.

    Jay Nelson

    Own Id: OTP-9960

  • [httpc] Add function for retrieving current options, get_options/[1,2].

    Own Id: OTP-9979

  • Utility module http_uri now officially supported.

    Also, the http_uri:parse function has been extended with more scheme support and a way to provide your own scheme info.

    Own Id: OTP-9983

    Aux Id: Seq 12022

-

-

  • [ftp] Fails to open IPv6 connection due to badly formatted IPv6 address in EPRT command. The address part of the command incorrectly contained decimal elements instead of hexadecimal.

    Own Id: OTP-9827

    Aux Id: Seq 11970

  • [httpc] Bad Keep Alive Mode. When selecting a session, the "state" of the session (specifically if the server has responded) was not taken into account.

    Own Id: OTP-9847

  • [httpc] The client incorrectly streams 404 responses. The documentation specifies that only 200 and 206 responses shall be streamed.

    Shane Evens

    Own Id: OTP-9860

  • [ftpc] Add a config option to specify a data connect timeout. That is how long the ftp client will wait for the server to connect to the data socket. If this timeout occurs, an error will be returned to the caller and the ftp client process will be terminated.

    Own Id: OTP-9545

  • [httpc] Wrong Host header in IPv6 HTTP requests. When a URI with a IPv6 host is parsed, the brackets that encapsulates the address part is removed. This value is then supplied as the host header. This can cause problems with some servers. A workaround for this is to use headers_as_is and provide the host header with the request call. To solve this a new option has been added, ipv6_host_with_brackets. This option specifies if the host value of the host header shall include the brackets or not. By default, it does not (as before).

    Own Id: OTP-9628

  • [httpd] Fix logging of content length in mod_log.

    Garrett Smith

    Own Id: OTP-9715

  • [httpd] Sometimes entries in the transfer log was written with the message size as list of numbers. This list was actually the size as a string, e.g. "123", written with the control sequence ~w. This has now been corrected so that any string is converted to an integer (if possible).

    Own Id: OTP-9733

  • Fixed various problems detected by Dialyzer.

    Own Id: OTP-9736

  • [httpc] Deprecated interface module http has been removed. It has (long) been replaced by http client interface module httpc.

    Own Id: OTP-9359

  • [httpc|httpd] The old ssl implementation (based on OpenSSL), has been deprecated. The config option that specified usage of this version of the ssl app, ossl, has been removed.

    Own Id: OTP-9522

-

  • [httpd] XSS prevention did not work for hex-encoded URL's.

    Own Id: OTP-9655

  • [httpd] GET request with malformed header date caused server crash (non-fatal) with no reply to client. Will now result in a reply with status code 400.

    Own Id: OTP-9674

    Aux Id: seq11936

-

  • [httpc] Parsing of a cookie expire date should be more forgiving. That is, if the parsing fails, the date should be ignored. Also added support for (yet another) date format: "Tue Jan 01 08:00:01 2036 GMT".

    Own Id: OTP-9433

  • [httpc] Rewrote cookie parsing. Among other things solving cookie processing from www.expedia.com.

    Own Id: OTP-9434

  • [httpd] Fix httpd directory traversal on Windows. Directory traversal was possible on Windows where backward slash is used as directory separator.

    András Veres-Szentkirályi.

    Own Id: OTP-9561

  • [httpc|httpd] Added support for IPv6 with ssl.

    Own Id: OTP-5566

  • [httpc] Remove unnecessary usage of iolist_to_binary when processing body (for PUT and POST).

    Filipe David Manana

    Own Id: OTP-9317

  • [ftp] FTP client doesn't work with IPv6 host.

    Attila Rajmund Nohl

    Own Id: OTP-9342 Aux Id: seq11853

  • [httpd] Peer/sockname resolv doesn't work with IPv6 addrs in HTTP.

    Attila Rajmund Nohl.

    Own Id: OTP-9343

  • [httpc] Clients started stand-alone not properly handled. Also it was not documented how to use them, that is that once started, they are represented by a pid() and not by their profile().

    Own Id: OTP-9365

  • [httpc] Add support for upload body streaming (PUT and POST).

    For more info, see the definition of the Body argument of the request/[4,5] function.

    Filipe David Manana

    Own Id: OTP-9094

  • [ftp] Added (type) spec for all exported functions.

    Own Id: OTP-9114 Aux Id: seq11799

  • [httpd] mod_esi:deliver/2 made to accept binary data.

    Bernard Duggan

    Own Id: OTP-9123

  • [httpd] Prevent XSS in error pages. Prevent user controlled input from being interpreted as HTML in error pages by encoding the reserved HTML characters.

    Michael Santos

    Own Id: OTP-9124

  • [httpd] Improved error messages.

    Ricardo Catalinas Jiménez

    Own Id: OTP-9157

  • [httpd] Extended support for file descriptors. In order to be able to bind to a privileged port without running the erlang VM as root, the support for using file descriptors has been improved. It is now possible to add the file descriptor to the config (option fd) when calling the inets:start(httpd, ...) function.

    Attila Rajmund Nohl

    Own Id: OTP-9202

    Aux Id: seq11819

  • The default ssl kind has now been changed to essl.

    ossl will work for as long as the ssl application supports it.

    See the httpd socket_type communication property or the httpc request/[4,5] function for more info.

    Own Id: OTP-9230

    *** POTENTIAL INCOMPATIBILITY ***

  • [httpd] Wrong security property names used in documentation.

    security_data_file used instead of data_file.

    security_max_retries used instead of max_retries.

    security_block_time used instead of block_time.

    security_fail_expire_time used instead of fail_expire_time.

    security_auth_timeout used instead of auth_timeout.

    Garrett Smith

    Own Id: OTP-9131

  • [httpd] Fix timeout message generated by mod_esi. When a mod_esi request times out, the code to send a timeout response was incorrect and generated an internal server error as well as an invalid response line.

    Bernard Duggan

    Own Id: OTP-9158

  • [httpc] httpc manager crashes. When a request results in a retry, the request id will be "reused" in the previous implementation a race condition could occur causing the manager to crash.

    This is now avoided by using proc_lib:init_ack and gen_server:enter_loop to allow more advanced initialization of httpc_handlers without blocking the httpc_manger and eliminating extra processes that can cause race conditions.

    Own Id: OTP-9246

  • [httpc] Issuing a request (httpc:request) to an host with the ssl option {ip, {127,0,0,1}} results in an handler crash. The reason was that the connect call resulted in an exit with reason badarg (this was the same for both ssl and gen_tcp).

    Exits was not caught. This has now been improved.

    Own Id: OTP-9289

    Aux Id: seq11845

-

  • [httpd] httpd_response:send_chunk handles empty list and empty binary - i.e. no chunk is sent, but it does not handle a list with an empty binary [<<>>]. This will be sent as an empty chunk - which in turn will be encoded by http_chunk to the same as a final chunk, which will make the http client believe that the end of the page is reached.

    Own Id: OTP-8906

  • Miscellaneous inet6 related problems.

    Own Id: OTP-8927

  • Updated http-server to make sure URLs in error-messages are URL-encoded. Added support in http-client to use URL-encoding. Also added the missing include directory for the inets application.

    Own Id: OTP-8940

    Aux Id: seq11735

  • Fix format_man_pages so it handles all man sections and remove warnings/errors in various man pages.

    Own Id: OTP-8600

  • [httpc] Pipelined and queued requests not processed when connection closed remotelly.

    Own Id: OTP-8906

  • [httpc] If a request times out (not connect timeout), the handler process exited (normal) but neglected to inform the manager process. For this reason, the manager did not clean up the request table., resulting in a memory leak. Also the manager did not create a monitor for the handler, so in an unforeseen handler crash, this could also create a memory leak.

    Own Id: OTP-8739

  • The service tftp was spelled wrong in documentation and in some parts of the code. It should be tftp.

    Own Id: OTP-8741 Aux Id: seq11635

  • [httpc] Replaced the old http client api module (http) with the new, httpc in the users guide.

    Own Id: OTP-8742

  • Eliminated warnings for auto-imported BIF clashes.

    Own Id: OTP-8840

  • [httpc|httpd] - Now allow the use of the "new" ssl, by using the essl tag instead.

    See the http_option option in the request/[4,5] or the socket-type section of the Communication properties chapter for more info,

    Own Id: OTP-7907

  • Deprecated functions designated to be removed in R14 has been removed. Also, some new functions has been marked as deprecated (the old http client api module).

    Own Id: OTP-8564

    *** POTENTIAL INCOMPATIBILITY ***

  • [httpd] - Improved mod_alias. Now able to do better URL rewrites.

    See URL aliasing properties and the CGI properties section(s) for more info,

    Own Id: OTP-8573

-

-

  • [httpc] - Made cookie handling more case insensitive.

    Own Id: OTP-8609

    Nicolas Thauvin

  • [httpc|httpd] - Netscape cookie dates can also be given with a 2-digit year (e.g. 06 = 2006).

    Own Id: OTP-8610

    Nicolas Thauvin

  • [httpd] - Added support (again) for the documented debugging features. See the User's Guide Configuration chapter for more info.

    Own Id: OTP-8624

-

  • [httpc] - Memory leak plugged. The profile manager never cleaned up in its handler database. This meant that with each new request handler, another entry was created that was never deleted. Eventually the request id counter (used as a key) would wrap, but the machine would most likely run out of memory before that happened.

    Own Id: OTP-8542

    Lev Walkin

  • [httpc] - https requests with default port (443) not handled properly.

    Own Id: OTP-8607

    jebu ittiachen

-

  • [httpc] - Badly formatted error reason for errors occurring during initial connect to a server. Also, the possible error reasons was not properly documented.

    Own Id: OTP-8508

    Aux Id: seq11407

  • [httpd] - Issues with ESI erl_script_timeout.

    • The erl_script_timeout config option is ducumented as a number of seconds. But when parsing the config, in the new format (not a config file), it was handled as if in number of milliseconds.

    • When the erl-script-timeout time was exceeded, the server incorrectly marked the answer as sent, thereby leaving client hanging (with an incomplete answer). This has been changed, so that now the socket will be closed.

    Own Id: OTP-8509

  • [httpc] - Allow users to pass socket options to the transport module when making requests.

    See the socket_opts option in the request/4 or set_options/[1,2] for more info,

    Own Id: OTP-8352

  • [httpc] Fix bug crafting Host header when port is not 80.

    The host header should include the port number as well as the host name when making a request to a server listening on a port other than the HTTP default of 80. Currently, only the host name is included. This is important to make the http client more compliant with the HTTP specification.

    Own Id: OTP-8371

    Kelly McLaughlin

  • [httpc|httpd] http_chunk data handling/passing improvement.

    This is a modification to the http_chunk module to forward any full chunk received, regardless of whether the size field for the following chunk has been received yet. This allows http_chunk to be used in situations where a long term HTTP connection is used to send periodic status updates as individual chunks. Previously a given chunk would not be forwarded to the client process until the size for the next chunk had been read which rendered the module difficult to use for the scenario described.

    Bernard Duggan

    Own Id: OTP-8351

  • Include the inets test suite in the release of the application.

    Own Id: OTP-8349

  • [httpc] - It is now possible to configure the client to deliver an async reply to more receivers then the calling process.

    See the receiver option for more info,

    Own Id: OTP-8106

  • [httpd] - Methods "PUT" and "DELETE" now allowed.

    huntermorris@gmail.com

    Own Id: OTP-8103

  • [httpc] Several more or less critical fixes:

    • Initial call between the httpc manager and request handler was synchronous.

      When the manager starts a new request handler, this is no longer a synchronous operation. Previously, the new request handler made the connection to the server and issuing of the first request (the reason for starting it) in the gen_server init function. If the connection for some reason "took some time", the manager hanged, leaving all other activities by that manager also hanging.

    As a side-effect of these changes, some modules was also renamed, and a new api module, httpc, has been introduced (the old module http is not removed, but is now just wrapper for httpc).

    Own Id: OTP-8016

    *** POTENTIAL INCOMPATIBILITY ***

  • [httpd] The server did not fully support the documented module callback api. Specifically, the load function should be able to return the atom ok, but this was not accepted.

    Own Id: OTP-8359

  • Fixing various documentation-related bugs (bad quotes).

    Own Id: OTP-8327

  • Fixing minor Dialyzer and copyright problem(s).

    Own Id: OTP-8315

  • [httpc] - Added basic sanity check of option value combinations.

    adam.kocoloski@gmail.com

    Own Id: OTP-8056

  • [ftpc] - Start of the FTP client has been changed in the following way:

    • It is now also possible to start a standalone FTP client process using the re-introduced ftp:open function.

      This is an alternative to starting the client using the inets service framework.

      The old ftp:open/1, undocumented, function, caused the client to be hooken into the inets service supervision framework. This is no longer the case.

      *** POTENTIAL INCOMPATIBILITY ***

    • Previously, the FTP client attempted to use IPv6, unless otherwise instructed (the ip_v6_disabled flag), and only used IPv4 if this did not work. This has now been changed.

      A new option, ipfamily, has been introduced, with the default value inet (IPv4).

      See ftp:open for more info.

      *** POTENTIAL INCOMPATIBILITY ***

    Own Id: OTP-8258

  • The documentation is now built with open source tools (xsltproc and fop) that exists on most platforms. One visible change is that the frames are removed.

    Own Id: OTP-8249

  • [httpc] - Streaming to file did not work.

    dizzyd@gmail.com

    Own Id: OTP-8204

  • [ftpc] - The ls/2 function (LIST command) and the nlist/2 function (NLST command) with wildcards did not work properly.

    These functions is documented as working on directories, but this is actually not according the standard. The LIST and NLST commands are specified to operate on a directory or other group of files, or a file.

    Previously, an attempt was made to check if the listing returned by the server was actually an error message. This was done by changing remote directory (cd) into the (assumed) "directory". This may work if Pathname was actually a directory, but as this is not always the case, this test does not work. Instead, we now return the actual server result and leave the interpretation to the caller.

    *** POTENTIAL INCOMPATIBILITY ***

    Own Id: OTP-8247

    Aux Id: seq11407

  • [httpc] - Fixes various bugs in timeout and keep-alive queue handling.

    • When a queued request times, out the error mssage is sent the owner of the active request.

    • Requests in the keep-alive queue is forgotten when handler terminates.

    • Timeout out requests are retried.

    Jean-Sébastien Pédron

    Own Id: OTP-8248

  • [httpd] - Unnecessarily strict matching when handling closing sockets.

    Own Id: OTP-8280

-

  • [httpc] - Raise condition. When http:request is called and httpc_manager selects a session where there's already a pending request, then the connection handler for that session effectively resets its parser, readying it for the response to the second request. But if there are still some inbound packets for the response to the first request, things get confused.

    tomas.abrahamsson@gmail.com

    Own Id: OTP-8154

  • [httpc] - Added http option connect_timeout for http client request. The connect_timeout option is used for the initial request, when the client connects to the server. Default value is that of the timeout option.

    See the request/[4,5] function for more info.

    Own Id: OTP-7298

  • [httpd] - Failed to create listen socket with invalid option combo. The http-server failed to create its listen socket when the bind-address was an IPv4-address (a tuple of size 4) and the ipfamily option was inet6fb4.

    Own Id: OTP-8118

    Aux Id: seq11321

  • [httpd] - Removed documentation for non-existing function (httpd_util:header/2,3,4).

    Own Id: OTP-8101

  • [httpd] - When starting inets (the web-server) and supplying a descriptor on the command line (example: erl -httpd_8888 <descriptor>) it is now possible to specify which ip-family to use: inet | inet6 | inet6fb4.

    Example: erl -httpd_8888 10|inet6

    When starting the web-server either using a file with property list (the proplist_file) or a an property list, using the ipfamily option: {ipfamily, inet | inet6 | inet6fb4}.

    Finally, when starting the web-server using the classical apache-style config file, the BindAddress directive has been augmented to allow the specification of the IpFamily: BindAddress blirk.ericsson.se|inet

    Default is inet6fb4 which emulates the behaviour of the previous version.

    See the Communication properties section for more info.

    Own Id: OTP-8069

    Aux Id: seq11086

  • [httpc] - Reception of unexpected data causes handler crash.

    Own Id: OTP-8052

  • [httpc] Added support for web services using only basic auth, with a token as the user part and no password part.

    twoggle@gmail.com

    Own Id: OTP-7998

  • [httpc] - Bind HTTP client to IP-addr. It is now possible to specify an alternate ip-address and port to be used when the client connects to the server.

    As a side-effect of this, the option ipv6 has been removed and replaced by the ipfamily option.

    See http:set_options/[1,2] for more info.

    *** POTENTIAL INCOMPATIBILITY ***

    Own Id: OTP-8004

  • Updated guard tests (i.e. is_list(L) instead of list(L) and possibly andalso/orelse instead of ","/";").

    Own Id: OTP-7994

  • [httpc] - Remove use of the deprecated regexp module.

    Own Id: OTP-8001

  • [httpc] - The option max_keep_alive_length was not handled properly.

    Own Id: OTP-8005

Copyright © 1997-2022 Ericsson AB. All Rights Reserved.