debing.sun ffff7fea7c Rebuild function engines for function flush command (#13383) ...

### Issue
The current implementation of `FUNCTION FLUSH` command uses
`lua_unref()` to unreference script closures in Lua vm. However,
invoking `lua_unref()` during lazy free (`ASYNC` argument) is risky
since it is not thread-safe.

Another issue is that using `lua_unref()` to unreference references does
not trigger GC, This can result in the Lua VM leaves a significant
amount of garbage, which may never be cleaned up if not properly GC.

### Solution
The proposed solution is to completely rebuild the engines, resulting in
a brand new Lua VM.

---------

Co-authored-by: meir <meir@redis.com>

2024-07-10 17:35:36 +08:00

..

commands

Update FIELDS argument to block type for HFE commands schema (#13339)

2024-06-14 13:51:49 +08:00

modules

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

.gitignore

…

acl.c

Free current client asynchronously after user permissions changes (#13274)

2024-05-30 22:09:30 +08:00

adlist.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

adlist.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

ae_epoll.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

ae_evport.c

Fix cluster bus extensions backwards compatibility (#10206)

2022-01-30 19:43:37 +02:00

ae_kqueue.c

Fix the timing of read and write events under kqueue (#9416)

2021-09-02 11:07:51 +03:00

ae_select.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

ae.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

ae.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

anet.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

anet.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

aof.c

Adapt HRANDFIELD to HFE feature (#13348)

2024-06-24 18:11:53 +03:00

asciilogo.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

atomicvar.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

bio.c

Change FLUSHALL/FLUSHDB SYNC to run as blocking ASYNC (#13167)

2024-04-02 15:09:52 +03:00

bio.h

Change FLUSHALL/FLUSHDB SYNC to run as blocking ASYNC (#13167)

2024-04-02 15:09:52 +03:00

bitops.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

blocked.c

Change FLUSHALL/FLUSHDB SYNC to run as blocking ASYNC (#13167)

2024-04-02 15:09:52 +03:00

call_reply.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

call_reply.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

childinfo.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

cli_commands.c

Reimplement cli hints based on command arg docs (#10515)

2023-03-30 19:03:56 +03:00

cli_commands.h

Reimplement cli hints based on command arg docs (#10515)

2023-03-30 19:03:56 +03:00

cli_common.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

cli_common.h

Adds connection timeout option to redis-cli (#10609)

2024-01-30 13:43:39 +02:00

cluster_legacy.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

cluster_legacy.h

Replace slots_to_channels radix tree with slot specific dictionaries for shard channels. (#12804)

2023-12-27 17:40:45 +08:00

cluster.c

Reduce getNodeByQuery overhead (#13221)

2024-07-03 18:23:14 +08:00

cluster.h

Reduce getNodeByQuery overhead (#13221)

2024-07-03 18:23:14 +08:00

commands.c

Reimplement cli hints based on command arg docs (#10515)

2023-03-30 19:03:56 +03:00

commands.def

Update FIELDS argument to block type for HFE commands schema (#13339)

2024-06-14 13:51:49 +08:00

commands.h

Replaced comment with excessive warning.

2023-07-16 17:04:15 -05:00

config.c

Hide user data from log (#13400)

2024-07-09 18:54:18 +08:00

config.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

connection.c

Remove prototypes with empty declarations (#12020)

2023-05-02 17:31:32 -07:00

connection.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

connhelpers.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

crc16_slottable.h

Change crc16 slot table to be fixed size character array instead of pointer to strings (#13112)

2024-03-08 15:50:36 -08:00

crc16.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

crc64.c

Add --large-memory flag for REDIS_TEST to enable tests that consume more than 100mb (#9784)

2021-11-16 08:55:10 +02:00

crc64.h

Add --large-memory flag for REDIS_TEST to enable tests that consume more than 100mb (#9784)

2021-11-16 08:55:10 +02:00

crcspeed.c

Fixed some typos, add a spell check ci and others minor fix (#8890)

2021-06-10 15:39:33 +03:00

crcspeed.h

Added crcspeed library

2020-04-24 17:11:21 -07:00

db.c

Fix possible crash due to OOM panic on invalid command (#13380)

2024-07-01 09:04:20 +03:00

debug.c

Hide user data from log (#13400)

2024-07-09 18:54:18 +08:00

debugmacro.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

defrag.c

Adapt HRANDFIELD to HFE feature (#13348)

2024-06-24 18:11:53 +03:00

dict.c

Hash Field Expiration - Basic support

2024-04-18 16:06:30 +03:00

dict.h

Hash Field Expiration - Basic support

2024-04-18 16:06:30 +03:00

ebuckets.c

Fix returned value nextExpireTime by ebExpire() (#13313)

2024-06-03 13:54:44 +03:00

ebuckets.h

Fix returned value nextExpireTime by ebExpire() (#13313)

2024-06-03 13:54:44 +03:00

endianconv.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

endianconv.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

eval.c

Add help for DEBUG SCRIPT command (#13385)

2024-07-04 14:44:42 +08:00

evict.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

expire.c

Hash Field Expiration - Basic support

2024-04-18 16:06:30 +03:00

fmacros.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

fmtargs.h

Rewrite huge printf calls to smaller ones for readability (#12257)

2023-09-28 09:21:23 +03:00

function_lua.c

Rebuild function engines for function flush command (#13383)

2024-07-10 17:35:36 +08:00

functions.c

Rebuild function engines for function flush command (#13383)

2024-07-10 17:35:36 +08:00

functions.h

Rebuild function engines for function flush command (#13383)

2024-07-10 17:35:36 +08:00

geo.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

geo.h

RDMF (Redis/Disque merge friendlyness) refactoring WIP 1.

2015-07-26 15:17:18 +02:00

geohash_helper.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

geohash_helper.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

geohash.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

geohash.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

hyperloglog.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

intset.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

intset.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

kvstore.c

Fix CI failure caused by PR #13231 (#13233)

2024-04-25 14:11:45 +08:00

kvstore.h

Fix dictionary use-after-free in active expire and make kvstore iter to respect EMPTY flag (#13135)

2024-03-18 17:41:54 +02:00

latency.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

latency.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

lazyfree.c

Rebuild function engines for function flush command (#13383)

2024-07-10 17:35:36 +08:00

listpack_malloc.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

listpack.c

Improve performance of hfe listpack (#13279)

2024-05-22 23:05:32 +03:00

listpack.h

Improve performance of hfe listpack (#13279)

2024-05-22 23:05:32 +03:00

localtime.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

logreqres.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

lolwut5.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

lolwut6.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

lolwut.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

lolwut.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

lzf_c.c

Change lzf to handle values larger than UINT32_MAX (#9776)

2021-11-16 13:12:25 +02:00

lzf_d.c

Change lzf to handle values larger than UINT32_MAX (#9776)

2021-11-16 13:12:25 +02:00

lzf.h

Change lzf to handle values larger than UINT32_MAX (#9776)

2021-11-16 13:12:25 +02:00

lzfP.h

Change lzf to handle values larger than UINT32_MAX (#9776)

2021-11-16 13:12:25 +02:00

Makefile

Hash Field Expiration (#13303)

2024-05-30 15:26:19 +08:00

memtest.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

mkreleasehdr.sh

fix the wrong path in mkreleasehdr.sh (#12993)

2024-01-26 15:01:54 -08:00

module.c

Reduce getNodeByQuery overhead (#13221)

2024-07-03 18:23:14 +08:00

monotonic.c

Better standardize around assertions (#12539)

2023-10-02 18:58:44 -07:00

monotonic.h

Remove prototypes with empty declarations (#12020)

2023-05-02 17:31:32 -07:00

mstr.c

Hash Field Expiration - Basic support

2024-04-18 16:06:30 +03:00

mstr.h

HFE to support AOF and replicas (#13285)

2024-05-29 19:47:48 +08:00

mt19937-64.c

Fix random element selection for large hash tables. (#8133)

2020-12-23 15:52:07 +02:00

mt19937-64.h

Fix random element selection for large hash tables. (#8133)

2020-12-23 15:52:07 +02:00

multi.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

networking.c

Don't keep global replication buffer reference for replicas marked CLIENT_CLOSE_ASAP (#13363)

2024-06-26 08:26:23 +08:00

notify.c

Hash Field Expiration - Basic support

2024-04-18 16:06:30 +03:00

object.c

Hash Field Expiration (#13303)

2024-05-30 15:26:19 +08:00

pqsort.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

pqsort.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

pubsub.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

quicklist.c

Add missing REDIS_STATIC in quicklist (#13147)

2024-03-18 08:22:19 +02:00

quicklist.h

Determine the large limit of the quicklist node based on fill (#12659)

2024-02-22 10:02:38 +02:00

rand.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

rand.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

rax_malloc.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

rax.c

Hash Field Expiration - Basic support

2024-04-18 16:06:30 +03:00

rax.h

Hash Field Expiration - Basic support

2024-04-18 16:06:30 +03:00

rdb.c

HFE - RDB serialize also hash min expiration (For ROF flow) (#13391)

2024-07-07 17:00:19 +03:00

rdb.h

HFE - RDB serialize also hash min expiration (For ROF flow) (#13391)

2024-07-07 17:00:19 +03:00

redis-benchmark.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

redis-check-aof.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

redis-check-rdb.c

HFE - RDB serialize also hash min expiration (For ROF flow) (#13391)

2024-07-07 17:00:19 +03:00

redis-cli.c

redis-cli --keystats and --keystats-samples with --top and --cursor (#12826)

2024-05-25 15:59:27 +08:00

redis-trib.rb

Redis-trib deprecated: it no longer works and it

2018-07-13 10:51:58 +02:00

redisassert.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

redisassert.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

redismodule.h

Add API RedisModule_ClusterKeySlot and RedisModule_ClusterCanonicalKeyNameInSlot (#13069)

2024-03-12 09:26:12 -07:00

release.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

replication.c

Hide user data from log (#13400)

2024-07-09 18:54:18 +08:00

resp_parser.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

resp_parser.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

rio.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

rio.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

script_lua.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

script_lua.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

script.c

Reduce getNodeByQuery overhead (#13221)

2024-07-03 18:23:14 +08:00

script.h

Add help for DEBUG SCRIPT command (#13385)

2024-07-04 14:44:42 +08:00

sds.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

sds.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

sdsalloc.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

sentinel.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

server.c

Reduce getNodeByQuery overhead (#13221)

2024-07-03 18:23:14 +08:00

server.h

Rebuild function engines for function flush command (#13383)

2024-07-10 17:35:36 +08:00

setcpuaffinity.c

cpu affinity: DragonFlyBSD support (#7956)

2020-10-25 14:14:05 +02:00

setproctitle.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

sha1.c

Ignore -Wstringop-overread warning for SHA1Transform() on GCC 12 (#11538)

2022-11-24 15:27:16 +02:00

sha1.h

Fix some compile warnings and errors when building with gcc-12 or clang (#12035)

2023-04-18 09:53:51 +03:00

sha256.c

Add sanitizer support and clean up sanitizer findings (#9601)

2021-11-11 13:51:33 +02:00

sha256.h

fix explanation of sha256 (#9220)

2021-07-10 10:04:54 -05:00

siphash.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

slowlog.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

slowlog.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

socket.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

solarisfixes.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

sort.c

HFE - Avoid lazy expire if called by modules + cleanup (#13326)

2024-06-10 11:24:26 +03:00

sparkline.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

sparkline.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

stream.h

XREADGROUP from PEL should not affect server.dirty (#13251)

2024-05-06 16:55:42 +08:00

strl.c

Avoid using unsafe C functions (#10932)

2022-07-18 10:56:26 +03:00

syncio.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

syscheck.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

syscheck.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

t_hash.c

HFE - RDB serialize also hash min expiration (For ROF flow) (#13391)

2024-07-07 17:00:19 +03:00

t_list.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

t_set.c

Add listpack support, hgetf and hsetf commands (#13209)

2024-05-08 23:11:32 +03:00

t_stream.c

XREADGROUP from PEL should not affect server.dirty (#13251)

2024-05-06 16:55:42 +08:00

t_string.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

t_zset.c

Add listpack support, hgetf and hsetf commands (#13209)

2024-05-08 23:11:32 +03:00

testhelp.h

Hash Field Expiration - Basic support

2024-04-18 16:06:30 +03:00

threads_mngr.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

threads_mngr.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

timeout.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

tls.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

tracking.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

unix.c

Manage number of new connections per cycle (#12178)

2024-01-02 15:15:03 -08:00

util.c

Log the real reason for why posix_fadvise failed (#13246)

2024-05-21 10:33:14 +08:00

util.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

valgrind.sup

Sanitize dump payload: fuzz tester and fixes for segfaults and leaks it exposed

2020-12-06 14:54:34 +02:00

version.h

Add Module API for version and compatibility checks (#7865)

2020-10-11 17:21:58 +03:00

ziplist.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

ziplist.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

zipmap.c

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

zipmap.h

Change license from BSD-3 to dual RSALv2+SSPLv1 (#13157)

2024-03-20 22:38:24 +00:00

zmalloc.c

Allocate Lua VM code with jemalloc instead of libc, and count it used memory (#13133)

2024-04-16 12:43:33 +03:00

zmalloc.h

Allocate Lua VM code with jemalloc instead of libc, and count it used memory (#13133)

2024-04-16 12:43:33 +03:00