caleb-brown/redict
1
0
Fork 0
mirror of https://codeberg.org/redict/redict.git synced 2025-01-23 16:48:27 -05:00
Code Issues Actions Packages Projects Releases Wiki Activity
247d2a734b
redict/src
History
zhaozhao.zz 247d2a734b networking: optimize parsing large bulk greater than 32k 
If we are going to read a large object from network
try to make it likely that it will start at c->querybuf
boundary so that we can optimize object creation
avoiding a large copy of data.

But only when the data we have not parsed is less than
or equal to ll+2. If the data length is greater than
ll+2, trimming querybuf is just a waste of time, because
at this time the querybuf contains not only our bulk.

It's easy to reproduce the that:

Time1: call `client pause 10000` on slave.

Time2: redis-benchmark -t set -r 10000 -d 33000 -n 10000.

Then slave hung after 10 seconds.
2018-09-04 00:02:25 +08:00
..
modules Fix typo 2018-07-03 18:19:46 +02:00
.gitignore Ignore gcov/lcov artifacts 2012-04-13 17:52:33 -07:00
adlist.c adlist: fix listJoin() in the case the second list is empty. 2017-11-28 18:25:14 +01:00
adlist.h Modules TSC: Handling of RM_Reply* functions. 2017-05-02 15:05:39 +02:00
ae_epoll.c various cleanups and minor fixes 2016-04-25 16:49:57 +03:00
ae_evport.c ae.c event loop: API to resize the fd set size on the run. 2013-06-28 16:39:49 +02:00
ae_kqueue.c No more trailing spaces in Redis source code. 2014-06-26 18:48:40 +02:00
ae_select.c Include 'fd_set' type name 2016-06-07 16:46:00 -04:00
ae.c Fix indentation. 2018-07-04 20:04:06 +08:00
ae.h Fix ae.c when a timer finalizerProc adds an event. 2018-03-28 14:11:04 +02:00
anet.c fix missed call on freeaddrinfo 2018-03-21 15:34:13 +08:00
anet.h Fix ae.c to avoid timers infinite loop. 2016-04-04 08:50:58 +02:00
aof.c Fix AOF comment to report the current behavior. 2018-08-03 12:46:06 +02:00
asciilogo.h BSD license added to every C source and header file. 2012-11-08 18:31:32 +01:00
atomicvar.h Fix typo 2018-07-03 18:19:46 +02:00
bio.c rdb: incremental fsync when redis saves rdb 2018-03-16 00:44:50 +08:00
bio.h Threaded lazyfree WIP #1. 2015-10-01 13:02:25 +02:00
bitops.c Fix typo 2018-07-03 18:19:46 +02:00
blocked.c block: format code 2018-08-14 20:59:32 +08:00
childinfo.c Clear child data when opening the pipes. 2016-09-19 14:11:17 +02:00
cluster.c Cluster cron announce IP minor refactoring. 2018-07-31 17:13:03 +02:00
cluster.h Fix typo 2018-07-03 18:19:46 +02:00
config.c Make slave-ignore-maxmemory configurable. 2018-08-27 12:27:17 +02:00
config.h rdb: incremental fsync when redis saves rdb 2018-03-16 00:44:50 +08:00
crc16.c RDMF (Redis/Disque merge friendlyness) refactoring WIP 1. 2015-07-26 15:17:18 +02:00
crc64.c Allow all code tests to run using Redis args 2014-12-23 09:31:03 -05:00
crc64.h Allow all code tests to run using Redis args 2014-12-23 09:31:03 -05:00
db.c refactor dbOverwrite to make lazyfree work 2018-07-31 12:07:57 +08:00
debug.c add DEBUG LOG, to to assist test suite debugging 2018-07-30 12:23:51 +03:00
debugmacro.h Use the standard predefined identifier __func__ (since C99) 2016-08-04 15:12:12 +08:00
defrag.c make active defrag test more stable 2018-07-18 10:16:33 +03:00
dict.c dict.c: remove a few trailing spaces. 2018-07-17 10:39:47 +02:00
dict.h dict: fix the int problem for defrag 2017-12-05 15:38:03 +01:00
endianconv.c Allow all code tests to run using Redis args 2014-12-23 09:31:03 -05:00
endianconv.h Fix typo 2018-07-03 18:19:46 +02:00
evict.c Introduce repl_slave_ignore_maxmemory flag internally. 2018-08-27 12:20:27 +02:00
expire.c fix typo 2018-06-21 22:08:09 +08:00
fmacros.h Silence _BSD_SOURCE warnings in glibc 2.20 and forward 2014-12-05 12:41:59 +11:00
geo.c Fix typo 2018-07-03 18:19:46 +02:00
geo.h RDMF (Redis/Disque merge friendlyness) refactoring WIP 1. 2015-07-26 15:17:18 +02:00
geohash_helper.c Fix GEORADIUS edge case with huge radius. 2017-07-03 19:38:31 +02:00
geohash_helper.h Fix definition of M_PI in geohash_helper.c. 2016-07-06 16:31:11 +02:00
geohash.c Update geohash.c 2018-06-12 15:28:28 +08:00
geohash.h Multiple GEORADIUS bugs fixed. 2016-07-27 11:34:25 +02:00
help.h Update help.h 2018-06-27 16:33:31 +03:00
hyperloglog.c Fix typo 2018-07-03 18:19:46 +02:00
intset.c Merge pull request #3242 from whatacold/unstable 2016-12-20 15:39:56 +01:00
intset.h Use const in Redis Module API where possible. 2016-06-20 23:08:06 +03:00
latency.c Revise the comments of latency command. 2018-08-22 18:07:02 +08:00
latency.h Separate latency monitoring of eviction loop and eviction DELs. 2015-02-11 10:52:27 +01:00
lazyfree.c refactor dbOverwrite to make lazyfree work 2018-07-31 12:07:57 +08:00
listpack_malloc.h Streams: change listpack allocator to zmalloc. 2017-12-01 10:24:24 +01:00
listpack.c Fix typo 2018-07-03 18:19:46 +02:00
listpack.h Streams: 12 commits squashed into the initial Streams implementation. 2017-12-01 10:24:24 +01:00
localtime.c update leap year comment 2018-07-13 09:46:30 -06:00
lzf_c.c Upgrade LZF to 3.6 (2011) from 3.5 (2009) 2015-01-02 11:16:10 -05:00
lzf_d.c Clean gcc 7.x warnings, redis-cli cluster fix. 2018-06-03 15:54:30 +03:00
lzf.h No more trailing spaces in Redis source code. 2014-06-26 18:48:40 +02:00
lzfP.h Fix undefined behavior constant defined. 2017-11-19 16:23:42 +00:00
Makefile Use nolocks_localtime() for safer logging. 2018-07-04 16:50:22 +02:00
memtest.c Hopefully better memory test on crash. 2015-12-16 17:41:22 +01:00
mkreleasehdr.sh Use SOURCE_DATE_EPOCH over unreproducible uname + date calls. 2016-04-29 16:45:53 +01:00
module.c Few typo fixes 2018-07-30 16:18:56 +03:00
multi.c Fix replication of SLAVEOF inside transaction. 2017-07-12 11:07:28 +02:00
networking.c networking: optimize parsing large bulk greater than 32k 2018-09-04 00:02:25 +08:00
notify.c Merge pull request #4237 from aspirewit/update-comment 2018-07-17 18:04:55 +02:00
object.c Change 42 to 1000 as warning level for cached scripts. 2018-07-23 18:44:58 +02:00
pqsort.c No more trailing spaces in Redis source code. 2014-06-26 18:48:40 +02:00
pqsort.h BSD license added to every C source and header file. 2012-11-08 18:31:32 +01:00
pubsub.c addReplySubSyntaxError() renamed to addReplySubcommandSyntaxError(). 2018-07-02 18:49:34 +02:00
quicklist.c Fix typo 2018-07-03 18:19:46 +02:00
quicklist.h quicklist: change the len of quicklist to unsigned long 2017-12-04 19:49:40 +08:00
rand.c Use 'void' for zero-argument functions 2014-08-08 10:05:32 +02:00
rand.h BSD license added to every C source and header file. 2012-11-08 18:31:32 +01:00
rax_malloc.h Cluster: hash slots tracking using a radix tree. 2017-03-27 16:37:22 +02:00
rax.c Fix typo 2018-07-03 18:19:46 +02:00
rax.h Fix typo 2018-07-03 18:19:46 +02:00
rdb.c Fix typo 2018-07-03 18:19:46 +02:00
rdb.h fix redis-rdb-check to provide proper arguments to rdbLoadMillisecondTime 2018-06-19 16:54:22 +03:00
redis-benchmark.c redis-benchmark: bugfix - handle zero liveclients in right way 2018-01-03 12:47:25 +08:00
redis-check-aof.c Correct proceding -> proceeding typo. 2017-07-14 22:53:14 +01:00
redis-check-rdb.c Delete unused role checking. 2018-07-12 21:21:37 +08:00
redis-cli.c Cluster Manager: more checks on --cluster-weight option. 2018-07-13 10:51:58 +02:00
redis-trib.rb Redis-trib deprecated: it no longer works and it 2018-07-13 10:51:58 +02:00
redisassert.h Fix typo 2018-07-03 18:19:46 +02:00
redismodule.h Modules API: Add call to get the blocked client handle from the context. 2018-04-13 13:48:11 +02:00
release.c No more trailing spaces in Redis source code. 2014-06-26 18:48:40 +02:00
replication.c fix rare replication stream corruption with disk-based replication 2018-07-17 12:51:49 +03:00
rio.c rdb: incremental fsync when redis saves rdb 2018-03-16 00:44:50 +08:00
rio.h fix processing of large bulks (above 2GB) 2017-12-29 12:24:19 +02:00
scripting.c After slave Lua script leaves busy state, re-process the master buffer. 2018-08-31 16:45:02 +02:00
sds.c bugfix in sdsReqType creating 64bit sds headers on 32bit systems 2018-07-15 18:24:18 +03:00
sds.h Merge pull request #3828 from oranagra/sdsnewlen_pr 2018-02-27 04:04:32 -08:00
sdsalloc.h SDS: changes to unify Redis SDS with antirez/sds repo. 2015-07-25 17:25:44 +02:00
sentinel.c Correct "did not received" -> "did not receive" typos/grammar. 2018-08-26 14:45:39 +02:00
server.c While the slave is busy, just accumulate master input. 2018-08-31 16:45:02 +02:00
server.h Introduce repl_slave_ignore_maxmemory flag internally. 2018-08-27 12:20:27 +02:00
setproctitle.c Fix undefined behavior constant defined. 2017-11-19 16:23:42 +00:00
sha1.c sha1.c: use standard uint32_t. 2015-04-27 12:07:49 +02:00
sha1.h sha1.c: use standard uint32_t. 2015-04-27 12:07:49 +02:00
siphash.c Clean gcc 7.x warnings, redis-cli cluster fix. 2018-06-03 15:54:30 +03:00
slowlog.c addReplySubSyntaxError() renamed to addReplySubcommandSyntaxError(). 2018-07-02 18:49:34 +02:00
slowlog.h Merge pull request #4056 from season89/unstable 2017-06-20 16:55:29 +02:00
solarisfixes.h Check for __sun macro in solarisfixes.h, not in includers. 2015-01-09 11:23:22 +01:00
sort.c Fix typo 2018-07-03 18:19:46 +02:00
sparkline.c RDMF (Redis/Disque merge friendlyness) refactoring WIP 1. 2015-07-26 15:17:18 +02:00
sparkline.h LATENCY GRAPH implemented. 2014-07-02 16:31:22 +02:00
stream.h Streams: add streamCompareID() declaration in stream.h. 2018-07-14 15:02:24 +08:00
syncio.c syncWithMaster(): non blocking state machine. 2015-08-06 18:12:20 +02:00
t_hash.c Merge pull request #3745 from guybe7/unstable 2018-02-13 15:50:21 +01:00
t_list.c block: rewrite BRPOPLPUSH as RPOPLPUSH to propagate 2018-08-14 20:58:58 +08:00
t_set.c Tranfer -> transfer typo fixed. 2018-07-31 16:41:33 +02:00
t_stream.c Merge pull request #5146 from 0xtonyxia/fix-xclaim-id-parse 2018-08-03 13:45:27 +02:00
t_string.c Fix incrDecrCommand() to create shared objects when needed. 2018-06-18 16:56:31 +02:00
t_zset.c Fix zslUpdateScore() edge case. 2018-08-01 19:04:53 +02:00
testhelp.h BSD license added to every C source and header file. 2012-11-08 18:31:32 +01:00
util.c string2ll(): better commenting. 2018-07-24 10:27:20 +02:00
util.h enlarged buffer given to ld2string 2017-01-11 19:24:19 +02:00
valgrind.sup more valgrind friendly test 2011-07-06 15:22:00 +02:00
version.h Mark version of unstable branch in an unique way. 2015-09-29 17:30:24 +02:00
ziplist.c Fix typo 2018-07-03 18:19:46 +02:00
ziplist.h DEBUG: new "ziplist" subcommand added. Dumps a ziplist on stdout. 2016-12-16 09:02:50 +01:00
zipmap.c Allow all code tests to run using Redis args 2014-12-23 09:31:03 -05:00
zipmap.h Allow all code tests to run using Redis args 2014-12-23 09:31:03 -05:00
zmalloc.c fix recursion typo in zmalloc_usable 2018-07-22 10:17:35 +03:00
zmalloc.h slave buffers were wasteful and incorrectly counted causing eviction 2018-07-16 16:43:42 +03:00