diff --git a/doc/concept/audio-jitter.md b/doc/concept/audio-jitter.md index ee1595d0d1c..3d73a17bf9c 100644 --- a/doc/concept/audio-jitter.md +++ b/doc/concept/audio-jitter.md @@ -107,19 +107,39 @@ observe(arrival, media): delay = max(0, (arrival - ref.arrival) - (media - ref.media)) if first observation: - origin = arrival; interval = 0; peak = delay; return + origin = arrival; interval = 0; peak = delay; note(arrival, delay); return index = floor((arrival - origin) / RESAMPLE) resumed = ended; ended = false if index <= interval: - peak = max(peak, delay); return + peak = max(peak, delay); note(arrival, delay); return - fold(bucket of peak) + close(bucket of peak) if resumed: # a declared silence folds nothing - origin = arrival; index = 0 - else: - fold(nothing) for each elapsed empty interval, at most IDLE_MAX - interval = index; peak = delay + settle(); origin = arrival; index = 0 + else: # held until this interval closes + pending = index - interval - 1 + interval = index; peak = delay; due = +inf; late = -inf + note(arrival, delay) + +note(arrival, delay): # due and late start at +inf and -inf + if delay > RESAMPLE: # stalled: due in an earlier interval + due = min(due, arrival - delay); late = max(late, arrival) + +close(bucket): # pending starts at 0 and is spent here + if late > -inf and a stall is open + and due < stall.late and due - stall.due < WINDOW: + stall.bucket = max(stall.bucket, bucket); stall.late = late + stall.span += pending + 1; pending = 0 + return # still behind the same stall + settle() + if late > -inf: open a stall with bucket, late, due, span = pending + else: fold(nothing) min(pending, IDLE_MAX) times; fold(bucket) + pending = 0 + +settle(): # a stall is one observation + if a stall is open: + fold(stall.bucket); fold(nothing) min(stall.span, IDLE_MAX) times; close it end(): # a declared end precedes the next observation if not first observation: ended = true @@ -222,6 +242,50 @@ about **135 s**. The forget factor decays **once per resampled observation, not once per arrival**. Applying a per-observation factor per arrival is the mistake the #3517 branch makes, and the resulting number reads plausible either way. +### One observation per stall + +An outage spans intervals, and the max per interval alone would count it once +per interval. A link that stops for 1.5 s and then delivers its backlog would +fold four or five peaks of a second or more, far past the 5% the quantile +needs, and a one-off would hold the target, and video with it, a second behind +live for 10 to 25 s after the link recovered. Those intervals are one event for +the same reason a queue's hundred frames are. + +A frame whose delay exceeds `RESAMPLE` was due in an earlier interval than the +one it arrived in, so it is **stalled**, and `arrival - delay` is when it was +due. An interval holding a stalled frame due before the open stall's latest +stalled frame arrived is still behind that stall: it joins it instead of +folding. The empty intervals before a stalled interval belong to its stall as +well, since a link that stops outright delivers nothing until its backlog +arrives, so empty intervals fold only once the interval after them closes and +shows whether it is stalled: a recovery that delivers the live edge before its +backlog is still a stall. The stall ends at the +first interval that does not continue it, and only then folds, once, its +largest delay, then one idle fold for each other interval it spanned. So the +estimate keeps its wall-clock time constant, and the stall's single observation +does not take the weight the idle folds return to the prior, which an +observation after them would reclaim up to `FRESH_MAX`. + +The test is on due time, not on adjacency, so a publisher that flushes a second +or more of media at once still counts each flush: the first frame of the next +flush was due only after the previous one arrived. Flushes back to back and +newest first do chain, since each is due before the previous one finished +arriving, and locally they look like outages one after another. So a stall +covers at most `WINDOW` of due time, the span the delay itself is measured +over, and longer lateness folds once per window as the recurring stall it is. +Recurring outages still +raise the target, a few of them within a half-life, which is the evidence a +recurring stall deserves. A lateness under one interval never stalls, so +ordinary jitter, shorter flushes, reordering, and a step in the path's delay fold one +observation per interval. + +The open stall is four numbers, so a publisher that chains stalls on purpose +costs nothing. While due times advance, one fold per window of due time bounds +how long the estimate goes without evidence. Only a publisher repeating an old +timestamp holds them still, since a frame more than `WINDOW` behind the newest +is not measured, and that holds its own stall open: it freezes its own +broadcast's estimate, at no cost beyond the four numbers. + ### The histogram An empirical distribution of `BUCKETS` buckets `BUCKET` wide, holding total @@ -410,7 +474,10 @@ Restarting would drop the target to the cold-start 100 ms at the switch, then raise it as the lateness is relearned, and the playout follows both moves. Only the reference window restarts, so the new track's frames are measured against its own fastest. Its opening backlog would read as seconds late against the old -track's arrivals. +track's arrivals. What the outgoing track measured but has not folded, its +interval in progress and any open stall, folds into the continued histogram as +if that interval closed at the switch: a switch most often follows an outage, +and would otherwise drop the outage's one observation. ## Rise, fall, startup, and the ceiling @@ -427,7 +494,11 @@ can hear, so the target should rise readily and fall grudgingly, and it does: hundreds of punctual frames around it. - **Falling** is driven by the forget factor alone, over the 20 s half-life above. Old mass in the tail has to decay out before the quantile can move - down, and nothing can make it decay faster. + down, and nothing can make it decay faster. What keeps a one-off from holding + the target is that it puts little mass there: an outage is + [one observation](#one-observation-per-stall), however many intervals its + backlog spans, while its stalled frames fall within `WINDOW` of due time; + a longer one is an observation per window. - **A single bad observation does not move the target on its own.** Once the prior is spent it adds `1 - FORGET` weight, 1.7%, well under the 5% the 95th percentile needs. It takes a few intervals of genuine lateness before the @@ -478,6 +549,9 @@ the same time constant as everything else, which is what an evidence-free interval should do, and it raises the target rather than lowering it, so the error is on the safe side. +Idle intervals fold when the interval after them closes, before it, unless +that interval is [stalled](#one-observation-per-stall), whose stall owns them. + `IDLE_MAX` caps how many intervals are folded at once. It exists only to bound the work: after 1024 folds the retained weight is about 2e-8, so the cap changes no output an `f64` can represent. @@ -603,6 +677,8 @@ index. Tolerance is 1e-6 ms, which the `f64` rules above make generous. | `tunein` | A stale frame then the live edge 14.5 s later leaves the target near the frame duration. This is the #3517 regression | | `spike` | A recurring stall raises the target, and it decays once the stalls stop | | `straggler` | One late interval after the prior is spent leaves the target where it was | +| `batches` | Back-to-back 1 s flushes delivered newest first chain their stalls, which still fold once per window of due time and raise the target | +| `outage` | A one-off 1.5 s outage whose backlog arrives over several intervals is one stall and leaves the target where it was, while three more 3 s apart raise it | | `fixed` | An explicit delay ignores the arrivals entirely | `reference.ts` beside them generated the numbers. It is **not normative and not diff --git a/doc/concept/audio-jitter/batches.json b/doc/concept/audio-jitter/batches.json new file mode 100644 index 00000000000..fce822682f1 --- /dev/null +++ b/doc/concept/audio-jitter/batches.json @@ -0,0 +1 @@ +{"name":"batches","about":"A publisher flushing 1 s of media at once, every second, newest frame first. Each flush is due before the previous one finished arriving, so the flushes chain, but a stall covers at most a window of due time, so they still fold and the target rises to cover the flush span.","frame":20,"arrival":[1050,1052,1054,1056,1058,1060,1062,1064,1066,1068,1070,1072,1074,1076,1078,1080,1082,1084,1086,1088,1090,1092,1094,1096,1098,1100,1102,1104,1106,1108,1110,1112,1114,1116,1118,1120,1122,1124,1126,1128,1130,1132,1134,1136,1138,1140,1142,1144,1146,1148,2050,2052,2054,2056,2058,2060,2062,2064,2066,2068,2070,2072,2074,2076,2078,2080,2082,2084,2086,2088,2090,2092,2094,2096,2098,2100,2102,2104,2106,2108,2110,2112,2114,2116,2118,2120,2122,2124,2126,2128,2130,2132,2134,2136,2138,2140,2142,2144,2146,2148,3050,3052,3054,3056,3058,3060,3062,3064,3066,3068,3070,3072,3074,3076,3078,3080,3082,3084,3086,3088,3090,3092,3094,3096,3098,3100,3102,3104,3106,3108,3110,3112,3114,3116,3118,3120,3122,3124,3126,3128,3130,3132,3134,3136,3138,3140,3142,3144,3146,3148,4050,4052,4054,4056,4058,4060,4062,4064,4066,4068,4070,4072,4074,4076,4078,4080,4082,4084,4086,4088,4090,4092,4094,4096,4098,4100,4102,4104,4106,4108,4110,4112,4114,4116,4118,4120,4122,4124,4126,4128,4130,4132,4134,4136,4138,4140,4142,4144,4146,4148,5050,5052,5054,5056,5058,5060,5062,5064,5066,5068,5070,5072,5074,5076,5078,5080,5082,5084,5086,5088,5090,5092,5094,5096,5098,5100,5102,5104,5106,5108,5110,5112,5114,5116,5118,5120,5122,5124,5126,5128,5130,5132,5134,5136,5138,5140,5142,5144,5146,5148,6050,6052,6054,6056,6058,6060,6062,6064,6066,6068,6070,6072,6074,6076,6078,6080,6082,6084,6086,6088,6090,6092,6094,6096,6098,6100,6102,6104,6106,6108,6110,6112,6114,6116,6118,6120,6122,6124,6126,6128,6130,6132,6134,6136,6138,6140,6142,6144,6146,6148,7050,7052,7054,7056,7058,7060,7062,7064,7066,7068,7070,7072,7074,7076,7078,7080,7082,7084,7086,7088,7090,7092,7094,7096,7098,7100,7102,7104,7106,7108,7110,7112,7114,7116,7118,7120,7122,7124,7126,7128,7130,7132,7134,7136,7138,7140,7142,7144,7146,7148,8050,8052,8054,8056,8058,8060,8062,8064,8066,8068,8070,8072,8074,8076,8078,8080,8082,8084,8086,8088,8090,8092,8094,8096,8098,8100,8102,8104,8106,8108,8110,8112,8114,8116,8118,8120,8122,8124,8126,8128,8130,8132,8134,8136,8138,8140,8142,8144,8146,8148,9050,9052,9054,9056,9058,9060,9062,9064,9066,9068,9070,9072,9074,9076,9078,9080,9082,9084,9086,9088,9090,9092,9094,9096,9098,9100,9102,9104,9106,9108,9110,9112,9114,9116,9118,9120,9122,9124,9126,9128,9130,9132,9134,9136,9138,9140,9142,9144,9146,9148,10050,10052,10054,10056,10058,10060,10062,10064,10066,10068,10070,10072,10074,10076,10078,10080,10082,10084,10086,10088,10090,10092,10094,10096,10098,10100,10102,10104,10106,10108,10110,10112,10114,10116,10118,10120,10122,10124,10126,10128,10130,10132,10134,10136,10138,10140,10142,10144,10146,10148,11050,11052,11054,11056,11058,11060,11062,11064,11066,11068,11070,11072,11074,11076,11078,11080,11082,11084,11086,11088,11090,11092,11094,11096,11098,11100,11102,11104,11106,11108,11110,11112,11114,11116,11118,11120,11122,11124,11126,11128,11130,11132,11134,11136,11138,11140,11142,11144,11146,11148,12050,12052,12054,12056,12058,12060,12062,12064,12066,12068,12070,12072,12074,12076,12078,12080,12082,12084,12086,12088,12090,12092,12094,12096,12098,12100,12102,12104,12106,12108,12110,12112,12114,12116,12118,12120,12122,12124,12126,12128,12130,12132,12134,12136,12138,12140,12142,12144,12146,12148,13050,13052,13054,13056,13058,13060,13062,13064,13066,13068,13070,13072,13074,13076,13078,13080,13082,13084,13086,13088,13090,13092,13094,13096,13098,13100,13102,13104,13106,13108,13110,13112,13114,13116,13118,13120,13122,13124,13126,13128,13130,13132,13134,13136,13138,13140,13142,13144,13146,13148,14050,14052,14054,14056,14058,14060,14062,14064,14066,14068,14070,14072,14074,14076,14078,14080,14082,14084,14086,14088,14090,14092,14094,14096,14098,14100,14102,14104,14106,14108,14110,14112,14114,14116,14118,14120,14122,14124,14126,14128,14130,14132,14134,14136,14138,14140,14142,14144,14146,14148,15050,15052,15054,15056,15058,15060,15062,15064,15066,15068,15070,15072,15074,15076,15078,15080,15082,15084,15086,15088,15090,15092,15094,15096,15098,15100,15102,15104,15106,15108,15110,15112,15114,15116,15118,15120,15122,15124,15126,15128,15130,15132,15134,15136,15138,15140,15142,15144,15146,15148,16050,16052,16054,16056,16058,16060,16062,16064,16066,16068,16070,16072,16074,16076,16078,16080,16082,16084,16086,16088,16090,16092,16094,16096,16098,16100,16102,16104,16106,16108,16110,16112,16114,16116,16118,16120,16122,16124,16126,16128,16130,16132,16134,16136,16138,16140,16142,16144,16146,16148,17050,17052,17054,17056,17058,17060,17062,17064,17066,17068,17070,17072,17074,17076,17078,17080,17082,17084,17086,17088,17090,17092,17094,17096,17098,17100,17102,17104,17106,17108,17110,17112,17114,17116,17118,17120,17122,17124,17126,17128,17130,17132,17134,17136,17138,17140,17142,17144,17146,17148,18050,18052,18054,18056,18058,18060,18062,18064,18066,18068,18070,18072,18074,18076,18078,18080,18082,18084,18086,18088,18090,18092,18094,18096,18098,18100,18102,18104,18106,18108,18110,18112,18114,18116,18118,18120,18122,18124,18126,18128,18130,18132,18134,18136,18138,18140,18142,18144,18146,18148,19050,19052,19054,19056,19058,19060,19062,19064,19066,19068,19070,19072,19074,19076,19078,19080,19082,19084,19086,19088,19090,19092,19094,19096,19098,19100,19102,19104,19106,19108,19110,19112,19114,19116,19118,19120,19122,19124,19126,19128,19130,19132,19134,19136,19138,19140,19142,19144,19146,19148,20050,20052,20054,20056,20058,20060,20062,20064,20066,20068,20070,20072,20074,20076,20078,20080,20082,20084,20086,20088,20090,20092,20094,20096,20098,20100,20102,20104,20106,20108,20110,20112,20114,20116,20118,20120,20122,20124,20126,20128,20130,20132,20134,20136,20138,20140,20142,20144,20146,20148,21050,21052,21054,21056,21058,21060,21062,21064,21066,21068,21070,21072,21074,21076,21078,21080,21082,21084,21086,21088,21090,21092,21094,21096,21098,21100,21102,21104,21106,21108,21110,21112,21114,21116,21118,21120,21122,21124,21126,21128,21130,21132,21134,21136,21138,21140,21142,21144,21146,21148,22050,22052,22054,22056,22058,22060,22062,22064,22066,22068,22070,22072,22074,22076,22078,22080,22082,22084,22086,22088,22090,22092,22094,22096,22098,22100,22102,22104,22106,22108,22110,22112,22114,22116,22118,22120,22122,22124,22126,22128,22130,22132,22134,22136,22138,22140,22142,22144,22146,22148,23050,23052,23054,23056,23058,23060,23062,23064,23066,23068,23070,23072,23074,23076,23078,23080,23082,23084,23086,23088,23090,23092,23094,23096,23098,23100,23102,23104,23106,23108,23110,23112,23114,23116,23118,23120,23122,23124,23126,23128,23130,23132,23134,23136,23138,23140,23142,23144,23146,23148,24050,24052,24054,24056,24058,24060,24062,24064,24066,24068,24070,24072,24074,24076,24078,24080,24082,24084,24086,24088,24090,24092,24094,24096,24098,24100,24102,24104,24106,24108,24110,24112,24114,24116,24118,24120,24122,24124,24126,24128,24130,24132,24134,24136,24138,24140,24142,24144,24146,24148,25050,25052,25054,25056,25058,25060,25062,25064,25066,25068,25070,25072,25074,25076,25078,25080,25082,25084,25086,25088,25090,25092,25094,25096,25098,25100,25102,25104,25106,25108,25110,25112,25114,25116,25118,25120,25122,25124,25126,25128,25130,25132,25134,25136,25138,25140,25142,25144,25146,25148,26050,26052,26054,26056,26058,26060,26062,26064,26066,26068,26070,26072,26074,26076,26078,26080,26082,26084,26086,26088,26090,26092,26094,26096,26098,26100,26102,26104,26106,26108,26110,26112,26114,26116,26118,26120,26122,26124,26126,26128,26130,26132,26134,26136,26138,26140,26142,26144,26146,26148,27050,27052,27054,27056,27058,27060,27062,27064,27066,27068,27070,27072,27074,27076,27078,27080,27082,27084,27086,27088,27090,27092,27094,27096,27098,27100,27102,27104,27106,27108,27110,27112,27114,27116,27118,27120,27122,27124,27126,27128,27130,27132,27134,27136,27138,27140,27142,27144,27146,27148,28050,28052,28054,28056,28058,28060,28062,28064,28066,28068,28070,28072,28074,28076,28078,28080,28082,28084,28086,28088,28090,28092,28094,28096,28098,28100,28102,28104,28106,28108,28110,28112,28114,28116,28118,28120,28122,28124,28126,28128,28130,28132,28134,28136,28138,28140,28142,28144,28146,28148,29050,29052,29054,29056,29058,29060,29062,29064,29066,29068,29070,29072,29074,29076,29078,29080,29082,29084,29086,29088,29090,29092,29094,29096,29098,29100,29102,29104,29106,29108,29110,29112,29114,29116,29118,29120,29122,29124,29126,29128,29130,29132,29134,29136,29138,29140,29142,29144,29146,29148,30050,30052,30054,30056,30058,30060,30062,30064,30066,30068,30070,30072,30074,30076,30078,30080,30082,30084,30086,30088,30090,30092,30094,30096,30098,30100,30102,30104,30106,30108,30110,30112,30114,30116,30118,30120,30122,30124,30126,30128,30130,30132,30134,30136,30138,30140,30142,30144,30146,30148,31050,31052,31054,31056,31058,31060,31062,31064,31066,31068,31070,31072,31074,31076,31078,31080,31082,31084,31086,31088,31090,31092,31094,31096,31098,31100,31102,31104,31106,31108,31110,31112,31114,31116,31118,31120,31122,31124,31126,31128,31130,31132,31134,31136,31138,31140,31142,31144,31146,31148,32050,32052,32054,32056,32058,32060,32062,32064,32066,32068,32070,32072,32074,32076,32078,32080,32082,32084,32086,32088,32090,32092,32094,32096,32098,32100,32102,32104,32106,32108,32110,32112,32114,32116,32118,32120,32122,32124,32126,32128,32130,32132,32134,32136,32138,32140,32142,32144,32146,32148,33050,33052,33054,33056,33058,33060,33062,33064,33066,33068,33070,33072,33074,33076,33078,33080,33082,33084,33086,33088,33090,33092,33094,33096,33098,33100,33102,33104,33106,33108,33110,33112,33114,33116,33118,33120,33122,33124,33126,33128,33130,33132,33134,33136,33138,33140,33142,33144,33146,33148,34050,34052,34054,34056,34058,34060,34062,34064,34066,34068,34070,34072,34074,34076,34078,34080,34082,34084,34086,34088,34090,34092,34094,34096,34098,34100,34102,34104,34106,34108,34110,34112,34114,34116,34118,34120,34122,34124,34126,34128,34130,34132,34134,34136,34138,34140,34142,34144,34146,34148,35050,35052,35054,35056,35058,35060,35062,35064,35066,35068,35070,35072,35074,35076,35078,35080,35082,35084,35086,35088,35090,35092,35094,35096,35098,35100,35102,35104,35106,35108,35110,35112,35114,35116,35118,35120,35122,35124,35126,35128,35130,35132,35134,35136,35138,35140,35142,35144,35146,35148,36050,36052,36054,36056,36058,36060,36062,36064,36066,36068,36070,36072,36074,36076,36078,36080,36082,36084,36086,36088,36090,36092,36094,36096,36098,36100,36102,36104,36106,36108,36110,36112,36114,36116,36118,36120,36122,36124,36126,36128,36130,36132,36134,36136,36138,36140,36142,36144,36146,36148,37050,37052,37054,37056,37058,37060,37062,37064,37066,37068,37070,37072,37074,37076,37078,37080,37082,37084,37086,37088,37090,37092,37094,37096,37098,37100,37102,37104,37106,37108,37110,37112,37114,37116,37118,37120,37122,37124,37126,37128,37130,37132,37134,37136,37138,37140,37142,37144,37146,37148,38050,38052,38054,38056,38058,38060,38062,38064,38066,38068,38070,38072,38074,38076,38078,38080,38082,38084,38086,38088,38090,38092,38094,38096,38098,38100,38102,38104,38106,38108,38110,38112,38114,38116,38118,38120,38122,38124,38126,38128,38130,38132,38134,38136,38138,38140,38142,38144,38146,38148,39050,39052,39054,39056,39058,39060,39062,39064,39066,39068,39070,39072,39074,39076,39078,39080,39082,39084,39086,39088,39090,39092,39094,39096,39098,39100,39102,39104,39106,39108,39110,39112,39114,39116,39118,39120,39122,39124,39126,39128,39130,39132,39134,39136,39138,39140,39142,39144,39146,39148,40050,40052,40054,40056,40058,40060,40062,40064,40066,40068,40070,40072,40074,40076,40078,40080,40082,40084,40086,40088,40090,40092,40094,40096,40098,40100,40102,40104,40106,40108,40110,40112,40114,40116,40118,40120,40122,40124,40126,40128,40130,40132,40134,40136,40138,40140,40142,40144,40146,40148],"media":[980,960,940,920,900,880,860,840,820,800,780,760,740,720,700,680,660,640,620,600,580,560,540,520,500,480,460,440,420,400,380,360,340,320,300,280,260,240,220,200,180,160,140,120,100,80,60,40,20,0,1980,1960,1940,1920,1900,1880,1860,1840,1820,1800,1780,1760,1740,1720,1700,1680,1660,1640,1620,1600,1580,1560,1540,1520,1500,1480,1460,1440,1420,1400,1380,1360,1340,1320,1300,1280,1260,1240,1220,1200,1180,1160,1140,1120,1100,1080,1060,1040,1020,1000,2980,2960,2940,2920,2900,2880,2860,2840,2820,2800,2780,2760,2740,2720,2700,2680,2660,2640,2620,2600,2580,2560,2540,2520,2500,2480,2460,2440,2420,2400,2380,2360,2340,2320,2300,2280,2260,2240,2220,2200,2180,2160,2140,2120,2100,2080,2060,2040,2020,2000,3980,3960,3940,3920,3900,3880,3860,3840,3820,3800,3780,3760,3740,3720,3700,3680,3660,3640,3620,3600,3580,3560,3540,3520,3500,3480,3460,3440,3420,3400,3380,3360,3340,3320,3300,3280,3260,3240,3220,3200,3180,3160,3140,3120,3100,3080,3060,3040,3020,3000,4980,4960,4940,4920,4900,4880,4860,4840,4820,4800,4780,4760,4740,4720,4700,4680,4660,4640,4620,4600,4580,4560,4540,4520,4500,4480,4460,4440,4420,4400,4380,4360,4340,4320,4300,4280,4260,4240,4220,4200,4180,4160,4140,4120,4100,4080,4060,4040,4020,4000,5980,5960,5940,5920,5900,5880,5860,5840,5820,5800,5780,5760,5740,5720,5700,5680,5660,5640,5620,5600,5580,5560,5540,5520,5500,5480,5460,5440,5420,5400,5380,5360,5340,5320,5300,5280,5260,5240,5220,5200,5180,5160,5140,5120,5100,5080,5060,5040,5020,5000,6980,6960,6940,6920,6900,6880,6860,6840,6820,6800,6780,6760,6740,6720,6700,6680,6660,6640,6620,6600,6580,6560,6540,6520,6500,6480,6460,6440,6420,6400,6380,6360,6340,6320,6300,6280,6260,6240,6220,6200,6180,6160,6140,6120,6100,6080,6060,6040,6020,6000,7980,7960,7940,7920,7900,7880,7860,7840,7820,7800,7780,7760,7740,7720,7700,7680,7660,7640,7620,7600,7580,7560,7540,7520,7500,7480,7460,7440,7420,7400,7380,7360,7340,7320,7300,7280,7260,7240,7220,7200,7180,7160,7140,7120,7100,7080,7060,7040,7020,7000,8980,8960,8940,8920,8900,8880,8860,8840,8820,8800,8780,8760,8740,8720,8700,8680,8660,8640,8620,8600,8580,8560,8540,8520,8500,8480,8460,8440,8420,8400,8380,8360,8340,8320,8300,8280,8260,8240,8220,8200,8180,8160,8140,8120,8100,8080,8060,8040,8020,8000,9980,9960,9940,9920,9900,9880,9860,9840,9820,9800,9780,9760,9740,9720,9700,9680,9660,9640,9620,9600,9580,9560,9540,9520,9500,9480,9460,9440,9420,9400,9380,9360,9340,9320,9300,9280,9260,9240,9220,9200,9180,9160,9140,9120,9100,9080,9060,9040,9020,9000,10980,10960,10940,10920,10900,10880,10860,10840,10820,10800,10780,10760,10740,10720,10700,10680,10660,10640,10620,10600,10580,10560,10540,10520,10500,10480,10460,10440,10420,10400,10380,10360,10340,10320,10300,10280,10260,10240,10220,10200,10180,10160,10140,10120,10100,10080,10060,10040,10020,10000,11980,11960,11940,11920,11900,11880,11860,11840,11820,11800,11780,11760,11740,11720,11700,11680,11660,11640,11620,11600,11580,11560,11540,11520,11500,11480,11460,11440,11420,11400,11380,11360,11340,11320,11300,11280,11260,11240,11220,11200,11180,11160,11140,11120,11100,11080,11060,11040,11020,11000,12980,12960,12940,12920,12900,12880,12860,12840,12820,12800,12780,12760,12740,12720,12700,12680,12660,12640,12620,12600,12580,12560,12540,12520,12500,12480,12460,12440,12420,12400,12380,12360,12340,12320,12300,12280,12260,12240,12220,12200,12180,12160,12140,12120,12100,12080,12060,12040,12020,12000,13980,13960,13940,13920,13900,13880,13860,13840,13820,13800,13780,13760,13740,13720,13700,13680,13660,13640,13620,13600,13580,13560,13540,13520,13500,13480,13460,13440,13420,13400,13380,13360,13340,13320,13300,13280,13260,13240,13220,13200,13180,13160,13140,13120,13100,13080,13060,13040,13020,13000,14980,14960,14940,14920,14900,14880,14860,14840,14820,14800,14780,14760,14740,14720,14700,14680,14660,14640,14620,14600,14580,14560,14540,14520,14500,14480,14460,14440,14420,14400,14380,14360,14340,14320,14300,14280,14260,14240,14220,14200,14180,14160,14140,14120,14100,14080,14060,14040,14020,14000,15980,15960,15940,15920,15900,15880,15860,15840,15820,15800,15780,15760,15740,15720,15700,15680,15660,15640,15620,15600,15580,15560,15540,15520,15500,15480,15460,15440,15420,15400,15380,15360,15340,15320,15300,15280,15260,15240,15220,15200,15180,15160,15140,15120,15100,15080,15060,15040,15020,15000,16980,16960,16940,16920,16900,16880,16860,16840,16820,16800,16780,16760,16740,16720,16700,16680,16660,16640,16620,16600,16580,16560,16540,16520,16500,16480,16460,16440,16420,16400,16380,16360,16340,16320,16300,16280,16260,16240,16220,16200,16180,16160,16140,16120,16100,16080,16060,16040,16020,16000,17980,17960,17940,17920,17900,17880,17860,17840,17820,17800,17780,17760,17740,17720,17700,17680,17660,17640,17620,17600,17580,17560,17540,17520,17500,17480,17460,17440,17420,17400,17380,17360,17340,17320,17300,17280,17260,17240,17220,17200,17180,17160,17140,17120,17100,17080,17060,17040,17020,17000,18980,18960,18940,18920,18900,18880,18860,18840,18820,18800,18780,18760,18740,18720,18700,18680,18660,18640,18620,18600,18580,18560,18540,18520,18500,18480,18460,18440,18420,18400,18380,18360,18340,18320,18300,18280,18260,18240,18220,18200,18180,18160,18140,18120,18100,18080,18060,18040,18020,18000,19980,19960,19940,19920,19900,19880,19860,19840,19820,19800,19780,19760,19740,19720,19700,19680,19660,19640,19620,19600,19580,19560,19540,19520,19500,19480,19460,19440,19420,19400,19380,19360,19340,19320,19300,19280,19260,19240,19220,19200,19180,19160,19140,19120,19100,19080,19060,19040,19020,19000,20980,20960,20940,20920,20900,20880,20860,20840,20820,20800,20780,20760,20740,20720,20700,20680,20660,20640,20620,20600,20580,20560,20540,20520,20500,20480,20460,20440,20420,20400,20380,20360,20340,20320,20300,20280,20260,20240,20220,20200,20180,20160,20140,20120,20100,20080,20060,20040,20020,20000,21980,21960,21940,21920,21900,21880,21860,21840,21820,21800,21780,21760,21740,21720,21700,21680,21660,21640,21620,21600,21580,21560,21540,21520,21500,21480,21460,21440,21420,21400,21380,21360,21340,21320,21300,21280,21260,21240,21220,21200,21180,21160,21140,21120,21100,21080,21060,21040,21020,21000,22980,22960,22940,22920,22900,22880,22860,22840,22820,22800,22780,22760,22740,22720,22700,22680,22660,22640,22620,22600,22580,22560,22540,22520,22500,22480,22460,22440,22420,22400,22380,22360,22340,22320,22300,22280,22260,22240,22220,22200,22180,22160,22140,22120,22100,22080,22060,22040,22020,22000,23980,23960,23940,23920,23900,23880,23860,23840,23820,23800,23780,23760,23740,23720,23700,23680,23660,23640,23620,23600,23580,23560,23540,23520,23500,23480,23460,23440,23420,23400,23380,23360,23340,23320,23300,23280,23260,23240,23220,23200,23180,23160,23140,23120,23100,23080,23060,23040,23020,23000,24980,24960,24940,24920,24900,24880,24860,24840,24820,24800,24780,24760,24740,24720,24700,24680,24660,24640,24620,24600,24580,24560,24540,24520,24500,24480,24460,24440,24420,24400,24380,24360,24340,24320,24300,24280,24260,24240,24220,24200,24180,24160,24140,24120,24100,24080,24060,24040,24020,24000,25980,25960,25940,25920,25900,25880,25860,25840,25820,25800,25780,25760,25740,25720,25700,25680,25660,25640,25620,25600,25580,25560,25540,25520,25500,25480,25460,25440,25420,25400,25380,25360,25340,25320,25300,25280,25260,25240,25220,25200,25180,25160,25140,25120,25100,25080,25060,25040,25020,25000,26980,26960,26940,26920,26900,26880,26860,26840,26820,26800,26780,26760,26740,26720,26700,26680,26660,26640,26620,26600,26580,26560,26540,26520,26500,26480,26460,26440,26420,26400,26380,26360,26340,26320,26300,26280,26260,26240,26220,26200,26180,26160,26140,26120,26100,26080,26060,26040,26020,26000,27980,27960,27940,27920,27900,27880,27860,27840,27820,27800,27780,27760,27740,27720,27700,27680,27660,27640,27620,27600,27580,27560,27540,27520,27500,27480,27460,27440,27420,27400,27380,27360,27340,27320,27300,27280,27260,27240,27220,27200,27180,27160,27140,27120,27100,27080,27060,27040,27020,27000,28980,28960,28940,28920,28900,28880,28860,28840,28820,28800,28780,28760,28740,28720,28700,28680,28660,28640,28620,28600,28580,28560,28540,28520,28500,28480,28460,28440,28420,28400,28380,28360,28340,28320,28300,28280,28260,28240,28220,28200,28180,28160,28140,28120,28100,28080,28060,28040,28020,28000,29980,29960,29940,29920,29900,29880,29860,29840,29820,29800,29780,29760,29740,29720,29700,29680,29660,29640,29620,29600,29580,29560,29540,29520,29500,29480,29460,29440,29420,29400,29380,29360,29340,29320,29300,29280,29260,29240,29220,29200,29180,29160,29140,29120,29100,29080,29060,29040,29020,29000,30980,30960,30940,30920,30900,30880,30860,30840,30820,30800,30780,30760,30740,30720,30700,30680,30660,30640,30620,30600,30580,30560,30540,30520,30500,30480,30460,30440,30420,30400,30380,30360,30340,30320,30300,30280,30260,30240,30220,30200,30180,30160,30140,30120,30100,30080,30060,30040,30020,30000,31980,31960,31940,31920,31900,31880,31860,31840,31820,31800,31780,31760,31740,31720,31700,31680,31660,31640,31620,31600,31580,31560,31540,31520,31500,31480,31460,31440,31420,31400,31380,31360,31340,31320,31300,31280,31260,31240,31220,31200,31180,31160,31140,31120,31100,31080,31060,31040,31020,31000,32980,32960,32940,32920,32900,32880,32860,32840,32820,32800,32780,32760,32740,32720,32700,32680,32660,32640,32620,32600,32580,32560,32540,32520,32500,32480,32460,32440,32420,32400,32380,32360,32340,32320,32300,32280,32260,32240,32220,32200,32180,32160,32140,32120,32100,32080,32060,32040,32020,32000,33980,33960,33940,33920,33900,33880,33860,33840,33820,33800,33780,33760,33740,33720,33700,33680,33660,33640,33620,33600,33580,33560,33540,33520,33500,33480,33460,33440,33420,33400,33380,33360,33340,33320,33300,33280,33260,33240,33220,33200,33180,33160,33140,33120,33100,33080,33060,33040,33020,33000,34980,34960,34940,34920,34900,34880,34860,34840,34820,34800,34780,34760,34740,34720,34700,34680,34660,34640,34620,34600,34580,34560,34540,34520,34500,34480,34460,34440,34420,34400,34380,34360,34340,34320,34300,34280,34260,34240,34220,34200,34180,34160,34140,34120,34100,34080,34060,34040,34020,34000,35980,35960,35940,35920,35900,35880,35860,35840,35820,35800,35780,35760,35740,35720,35700,35680,35660,35640,35620,35600,35580,35560,35540,35520,35500,35480,35460,35440,35420,35400,35380,35360,35340,35320,35300,35280,35260,35240,35220,35200,35180,35160,35140,35120,35100,35080,35060,35040,35020,35000,36980,36960,36940,36920,36900,36880,36860,36840,36820,36800,36780,36760,36740,36720,36700,36680,36660,36640,36620,36600,36580,36560,36540,36520,36500,36480,36460,36440,36420,36400,36380,36360,36340,36320,36300,36280,36260,36240,36220,36200,36180,36160,36140,36120,36100,36080,36060,36040,36020,36000,37980,37960,37940,37920,37900,37880,37860,37840,37820,37800,37780,37760,37740,37720,37700,37680,37660,37640,37620,37600,37580,37560,37540,37520,37500,37480,37460,37440,37420,37400,37380,37360,37340,37320,37300,37280,37260,37240,37220,37200,37180,37160,37140,37120,37100,37080,37060,37040,37020,37000,38980,38960,38940,38920,38900,38880,38860,38840,38820,38800,38780,38760,38740,38720,38700,38680,38660,38640,38620,38600,38580,38560,38540,38520,38500,38480,38460,38440,38420,38400,38380,38360,38340,38320,38300,38280,38260,38240,38220,38200,38180,38160,38140,38120,38100,38080,38060,38040,38020,38000,39980,39960,39940,39920,39900,39880,39860,39840,39820,39800,39780,39760,39740,39720,39700,39680,39660,39640,39620,39600,39580,39560,39540,39520,39500,39480,39460,39440,39420,39400,39380,39360,39340,39320,39300,39280,39260,39240,39220,39200,39180,39160,39140,39120,39100,39080,39060,39040,39020,39000],"target":[[0,120],[200,1100]]} diff --git a/doc/concept/audio-jitter/corpus.ts b/doc/concept/audio-jitter/corpus.ts index 299328f8170..86af0397570 100644 --- a/doc/concept/audio-jitter/corpus.ts +++ b/doc/concept/audio-jitter/corpus.ts @@ -84,6 +84,23 @@ function gap(trace: Trace, at: number, length: number): Trace { return { arrival, media }; } +/** + * Hold a FIFO queue to one frame per `service` ms from `from` for `length` ms, as a link + * collapsing behind a full queue does, then drain it at 2 ms per frame. + */ +function outage(trace: Trace, from: number, length: number, service: number): Trace { + const arrival = [...trace.arrival]; + let free = Number.NEGATIVE_INFINITY; + for (let i = 0; i < arrival.length; i++) { + const start = Math.max(arrival[i], free); + if (start >= from && start < from + length) free = start + service; + else if (start > arrival[i]) free = start + 2; + else free = start; + arrival[i] = free; + } + return { arrival, media: trace.media }; +} + function paced(frames: number, frame: number, base: number): Trace { return flushed(frames, frame, 1, base); } @@ -217,6 +234,42 @@ const traces: Omit[] = [ return { arrival, media: trace.media }; })(), }, + { + name: "outage", + about: "Even audio with a 1.5 s outage 10 s in: a queue serving one frame per 300 ms, then draining the backlog, so its delays climb past a second across four intervals. The frames stuck behind it are one stall, which folds once, so the one-off leaves the target where it was. So does a 1.5 s blackout 20 s in, recovering with the live edge before its backlog, whose empty intervals belong to the stall that ends them. Three more outages 3 s apart from 30 s still raise it, and it decays once they stop.", + frame: FRAME, + ...(() => { + let trace = paced(3000, FRAME, 50); + trace = outage(trace, 10_050, 1500, 300); + trace = outage(trace, 20_050, 1500, 1500); + // The blackout recovers with the live edge first, then the backlog behind it. + const arrival = [...trace.arrival]; + const media = [...trace.media]; + const [edge] = media.splice(1075, 1); + arrival.splice(1075, 1); + media.splice(1000, 0, edge); + arrival.splice(1000, 0, arrival[1000]); + trace = { arrival, media }; + for (const at of [30_000, 33_000, 36_000]) trace = outage(trace, at + 50, 1500, 300); + return trace; + })(), + }, + { + name: "batches", + about: "A publisher flushing 1 s of media at once, every second, newest frame first. Each flush is due before the previous one finished arriving, so the flushes chain, but a stall covers at most a window of due time, so they still fold and the target rises to cover the flush span.", + frame: FRAME, + ...(() => { + const arrival: number[] = []; + const media: number[] = []; + for (let flush = 0; flush < 40; flush++) { + for (let k = 0; k < 50; k++) { + arrival.push(50 + (flush + 1) * 1000 + k * 2); + media.push(flush * 1000 + (49 - k) * FRAME); + } + } + return { arrival, media }; + })(), + }, { name: "straggler", about: "Even audio with a single 300 ms stall 8 s in, once the prior is spent. One interval of evidence is not enough to move the target, so the stall costs that one refill instead of raising the target and then dropping it, which skips buffered audio.", diff --git a/doc/concept/audio-jitter/idle.json b/doc/concept/audio-jitter/idle.json index a9bf341d439..7eca3a742ce 100644 --- a/doc/concept/audio-jitter/idle.json +++ b/doc/concept/audio-jitter/idle.json @@ -1 +1 @@ -{"name":"idle","about":"A 30 s gap in both clocks, as a suspended tab produces. The idle intervals relax the histogram back toward the prior rather than freezing it.","frame":20,"arrival":[50,70,90,110,130,150,170,190,210,230,250,270,290,310,330,350,370,390,410,430,450,470,490,510,530,550,570,590,610,630,650,670,690,710,730,750,770,790,810,830,850,870,890,910,930,950,970,990,1010,1030,1050,1070,1090,1110,1130,1150,1170,1190,1210,1230,1250,1270,1290,1310,1330,1350,1370,1390,1410,1430,1450,1470,1490,1510,1530,1550,1570,1590,1610,1630,1650,1670,1690,1710,1730,1750,1770,1790,1810,1830,1850,1870,1890,1910,1930,1950,1970,1990,2010,2030,2050,2070,2090,2110,2130,2150,2170,2190,2210,2230,2250,2270,2290,2310,2330,2350,2370,2390,2410,2430,2450,2470,2490,2510,2530,2550,2570,2590,2610,2630,2650,2670,2690,2710,2730,2750,2770,2790,2810,2830,2850,2870,2890,2910,2930,2950,2970,2990,3010,3030,3050,3070,3090,3110,3130,3150,3170,3190,3210,3230,3250,3270,3290,3310,3330,3350,3370,3390,3410,3430,3450,3470,3490,3510,3530,3550,3570,3590,3610,3630,3650,3670,3690,3710,3730,3750,3770,3790,3810,3830,3850,3870,3890,3910,3930,3950,3970,3990,4010,4030,4050,4070,4090,4110,4130,4150,4170,4190,4210,4230,4250,4270,4290,4310,4330,4350,4370,4390,4410,4430,4450,4470,4490,4510,4530,4550,4570,4590,4610,4630,4650,4670,4690,4710,4730,4750,4770,4790,4810,4830,4850,4870,4890,4910,4930,4950,4970,4990,5010,5030,5050,5070,5090,5110,5130,5150,5170,5190,5210,5230,5250,5270,5290,5310,5330,5350,5370,5390,5410,5430,5450,5470,5490,5510,5530,5550,5570,5590,5610,5630,5650,5670,5690,5710,5730,5750,5770,5790,5810,5830,5850,5870,5890,5910,5930,5950,5970,5990,6010,6030,6050,6070,6090,6110,6130,6150,6170,6190,6210,6230,6250,6270,6290,6310,6330,6350,6370,6390,6410,6430,6450,6470,6490,6510,6530,6550,6570,6590,6610,6630,6650,6670,6690,6710,6730,6750,6770,6790,6810,6830,6850,6870,6890,6910,6930,6950,6970,6990,7010,7030,7050,7070,7090,7110,7130,7150,7170,7190,7210,7230,7250,7270,7290,7310,7330,7350,7370,7390,7410,7430,7450,7470,7490,7510,7530,7550,7570,7590,7610,7630,7650,7670,7690,7710,7730,7750,7770,7790,7810,7830,7850,7870,7890,7910,7930,7950,7970,7990,8010,8030,8050,8070,8090,8110,8130,8150,8170,8190,8210,8230,8250,8270,8290,8310,8330,8350,8370,8390,8410,8430,8450,8470,8490,8510,8530,8550,8570,8590,8610,8630,8650,8670,8690,8710,8730,8750,8770,8790,8810,8830,8850,8870,8890,8910,8930,8950,8970,8990,9010,9030,9050,9070,9090,9110,9130,9150,9170,9190,9210,9230,9250,9270,9290,9310,9330,9350,9370,9390,9410,9430,9450,9470,9490,9510,9530,9550,9570,9590,9610,9630,9650,9670,9690,9710,9730,9750,9770,9790,9810,9830,9850,9870,9890,9910,9930,9950,9970,9990,10010,10030,40050,40070,40090,40110,40130,40150,40170,40190,40210,40230,40250,40270,40290,40310,40330,40350,40370,40390,40410,40430,40450,40470,40490,40510,40530,40550,40570,40590,40610,40630,40650,40670,40690,40710,40730,40750,40770,40790,40810,40830,40850,40870,40890,40910,40930,40950,40970,40990,41010,41030,41050,41070,41090,41110,41130,41150,41170,41190,41210,41230,41250,41270,41290,41310,41330,41350,41370,41390,41410,41430,41450,41470,41490,41510,41530,41550,41570,41590,41610,41630,41650,41670,41690,41710,41730,41750,41770,41790,41810,41830,41850,41870,41890,41910,41930,41950,41970,41990,42010,42030,42050,42070,42090,42110,42130,42150,42170,42190,42210,42230,42250,42270,42290,42310,42330,42350,42370,42390,42410,42430,42450,42470,42490,42510,42530,42550,42570,42590,42610,42630,42650,42670,42690,42710,42730,42750,42770,42790,42810,42830,42850,42870,42890,42910,42930,42950,42970,42990,43010,43030,43050,43070,43090,43110,43130,43150,43170,43190,43210,43230,43250,43270,43290,43310,43330,43350,43370,43390,43410,43430,43450,43470,43490,43510,43530,43550,43570,43590,43610,43630,43650,43670,43690,43710,43730,43750,43770,43790,43810,43830,43850,43870,43890,43910,43930,43950,43970,43990,44010,44030,44050,44070,44090,44110,44130,44150,44170,44190,44210,44230,44250,44270,44290,44310,44330,44350,44370,44390,44410,44430,44450,44470,44490,44510,44530,44550,44570,44590,44610,44630,44650,44670,44690,44710,44730,44750,44770,44790,44810,44830,44850,44870,44890,44910,44930,44950,44970,44990,45010,45030,45050,45070,45090,45110,45130,45150,45170,45190,45210,45230,45250,45270,45290,45310,45330,45350,45370,45390,45410,45430,45450,45470,45490,45510,45530,45550,45570,45590,45610,45630,45650,45670,45690,45710,45730,45750,45770,45790,45810,45830,45850,45870,45890,45910,45930,45950,45970,45990,46010,46030,46050,46070,46090,46110,46130,46150,46170,46190,46210,46230,46250,46270,46290,46310,46330,46350,46370,46390,46410,46430,46450,46470,46490,46510,46530,46550,46570,46590,46610,46630,46650,46670,46690,46710,46730,46750,46770,46790,46810,46830,46850,46870,46890,46910,46930,46950,46970,46990,47010,47030,47050,47070,47090,47110,47130,47150,47170,47190,47210,47230,47250,47270,47290,47310,47330,47350,47370,47390,47410,47430,47450,47470,47490,47510,47530,47550,47570,47590,47610,47630,47650,47670,47690,47710,47730,47750,47770,47790,47810,47830,47850,47870,47890,47910,47930,47950,47970,47990,48010,48030,48050,48070,48090,48110,48130,48150,48170,48190,48210,48230,48250,48270,48290,48310,48330,48350,48370,48390,48410,48430,48450,48470,48490,48510,48530,48550,48570,48590,48610,48630,48650,48670,48690,48710,48730,48750,48770,48790,48810,48830,48850,48870,48890,48910,48930,48950,48970,48990,49010,49030,49050,49070,49090,49110,49130,49150,49170,49190,49210,49230,49250,49270,49290,49310,49330,49350,49370,49390,49410,49430,49450,49470,49490,49510,49530,49550,49570,49590,49610,49630,49650,49670,49690,49710,49730,49750,49770,49790,49810,49830,49850,49870,49890,49910,49930,49950,49970,49990,50010,50030],"media":[0,20,40,60,80,100,120,140,160,180,200,220,240,260,280,300,320,340,360,380,400,420,440,460,480,500,520,540,560,580,600,620,640,660,680,700,720,740,760,780,800,820,840,860,880,900,920,940,960,980,1000,1020,1040,1060,1080,1100,1120,1140,1160,1180,1200,1220,1240,1260,1280,1300,1320,1340,1360,1380,1400,1420,1440,1460,1480,1500,1520,1540,1560,1580,1600,1620,1640,1660,1680,1700,1720,1740,1760,1780,1800,1820,1840,1860,1880,1900,1920,1940,1960,1980,2000,2020,2040,2060,2080,2100,2120,2140,2160,2180,2200,2220,2240,2260,2280,2300,2320,2340,2360,2380,2400,2420,2440,2460,2480,2500,2520,2540,2560,2580,2600,2620,2640,2660,2680,2700,2720,2740,2760,2780,2800,2820,2840,2860,2880,2900,2920,2940,2960,2980,3000,3020,3040,3060,3080,3100,3120,3140,3160,3180,3200,3220,3240,3260,3280,3300,3320,3340,3360,3380,3400,3420,3440,3460,3480,3500,3520,3540,3560,3580,3600,3620,3640,3660,3680,3700,3720,3740,3760,3780,3800,3820,3840,3860,3880,3900,3920,3940,3960,3980,4000,4020,4040,4060,4080,4100,4120,4140,4160,4180,4200,4220,4240,4260,4280,4300,4320,4340,4360,4380,4400,4420,4440,4460,4480,4500,4520,4540,4560,4580,4600,4620,4640,4660,4680,4700,4720,4740,4760,4780,4800,4820,4840,4860,4880,4900,4920,4940,4960,4980,5000,5020,5040,5060,5080,5100,5120,5140,5160,5180,5200,5220,5240,5260,5280,5300,5320,5340,5360,5380,5400,5420,5440,5460,5480,5500,5520,5540,5560,5580,5600,5620,5640,5660,5680,5700,5720,5740,5760,5780,5800,5820,5840,5860,5880,5900,5920,5940,5960,5980,6000,6020,6040,6060,6080,6100,6120,6140,6160,6180,6200,6220,6240,6260,6280,6300,6320,6340,6360,6380,6400,6420,6440,6460,6480,6500,6520,6540,6560,6580,6600,6620,6640,6660,6680,6700,6720,6740,6760,6780,6800,6820,6840,6860,6880,6900,6920,6940,6960,6980,7000,7020,7040,7060,7080,7100,7120,7140,7160,7180,7200,7220,7240,7260,7280,7300,7320,7340,7360,7380,7400,7420,7440,7460,7480,7500,7520,7540,7560,7580,7600,7620,7640,7660,7680,7700,7720,7740,7760,7780,7800,7820,7840,7860,7880,7900,7920,7940,7960,7980,8000,8020,8040,8060,8080,8100,8120,8140,8160,8180,8200,8220,8240,8260,8280,8300,8320,8340,8360,8380,8400,8420,8440,8460,8480,8500,8520,8540,8560,8580,8600,8620,8640,8660,8680,8700,8720,8740,8760,8780,8800,8820,8840,8860,8880,8900,8920,8940,8960,8980,9000,9020,9040,9060,9080,9100,9120,9140,9160,9180,9200,9220,9240,9260,9280,9300,9320,9340,9360,9380,9400,9420,9440,9460,9480,9500,9520,9540,9560,9580,9600,9620,9640,9660,9680,9700,9720,9740,9760,9780,9800,9820,9840,9860,9880,9900,9920,9940,9960,9980,40000,40020,40040,40060,40080,40100,40120,40140,40160,40180,40200,40220,40240,40260,40280,40300,40320,40340,40360,40380,40400,40420,40440,40460,40480,40500,40520,40540,40560,40580,40600,40620,40640,40660,40680,40700,40720,40740,40760,40780,40800,40820,40840,40860,40880,40900,40920,40940,40960,40980,41000,41020,41040,41060,41080,41100,41120,41140,41160,41180,41200,41220,41240,41260,41280,41300,41320,41340,41360,41380,41400,41420,41440,41460,41480,41500,41520,41540,41560,41580,41600,41620,41640,41660,41680,41700,41720,41740,41760,41780,41800,41820,41840,41860,41880,41900,41920,41940,41960,41980,42000,42020,42040,42060,42080,42100,42120,42140,42160,42180,42200,42220,42240,42260,42280,42300,42320,42340,42360,42380,42400,42420,42440,42460,42480,42500,42520,42540,42560,42580,42600,42620,42640,42660,42680,42700,42720,42740,42760,42780,42800,42820,42840,42860,42880,42900,42920,42940,42960,42980,43000,43020,43040,43060,43080,43100,43120,43140,43160,43180,43200,43220,43240,43260,43280,43300,43320,43340,43360,43380,43400,43420,43440,43460,43480,43500,43520,43540,43560,43580,43600,43620,43640,43660,43680,43700,43720,43740,43760,43780,43800,43820,43840,43860,43880,43900,43920,43940,43960,43980,44000,44020,44040,44060,44080,44100,44120,44140,44160,44180,44200,44220,44240,44260,44280,44300,44320,44340,44360,44380,44400,44420,44440,44460,44480,44500,44520,44540,44560,44580,44600,44620,44640,44660,44680,44700,44720,44740,44760,44780,44800,44820,44840,44860,44880,44900,44920,44940,44960,44980,45000,45020,45040,45060,45080,45100,45120,45140,45160,45180,45200,45220,45240,45260,45280,45300,45320,45340,45360,45380,45400,45420,45440,45460,45480,45500,45520,45540,45560,45580,45600,45620,45640,45660,45680,45700,45720,45740,45760,45780,45800,45820,45840,45860,45880,45900,45920,45940,45960,45980,46000,46020,46040,46060,46080,46100,46120,46140,46160,46180,46200,46220,46240,46260,46280,46300,46320,46340,46360,46380,46400,46420,46440,46460,46480,46500,46520,46540,46560,46580,46600,46620,46640,46660,46680,46700,46720,46740,46760,46780,46800,46820,46840,46860,46880,46900,46920,46940,46960,46980,47000,47020,47040,47060,47080,47100,47120,47140,47160,47180,47200,47220,47240,47260,47280,47300,47320,47340,47360,47380,47400,47420,47440,47460,47480,47500,47520,47540,47560,47580,47600,47620,47640,47660,47680,47700,47720,47740,47760,47780,47800,47820,47840,47860,47880,47900,47920,47940,47960,47980,48000,48020,48040,48060,48080,48100,48120,48140,48160,48180,48200,48220,48240,48260,48280,48300,48320,48340,48360,48380,48400,48420,48440,48460,48480,48500,48520,48540,48560,48580,48600,48620,48640,48660,48680,48700,48720,48740,48760,48780,48800,48820,48840,48860,48880,48900,48920,48940,48960,48980,49000,49020,49040,49060,49080,49100,49120,49140,49160,49180,49200,49220,49240,49260,49280,49300,49320,49340,49360,49380,49400,49420,49440,49460,49480,49500,49520,49540,49560,49580,49600,49620,49640,49660,49680,49700,49720,49740,49760,49780,49800,49820,49840,49860,49880,49900,49920,49940,49960,49980],"target":[[0,120],[75,100],[175,80],[225,60],[250,40],[500,100],[575,80],[625,60],[675,40]]} +{"name":"idle","about":"A 30 s gap in both clocks, as a suspended tab produces. The idle intervals relax the histogram back toward the prior rather than freezing it.","frame":20,"arrival":[50,70,90,110,130,150,170,190,210,230,250,270,290,310,330,350,370,390,410,430,450,470,490,510,530,550,570,590,610,630,650,670,690,710,730,750,770,790,810,830,850,870,890,910,930,950,970,990,1010,1030,1050,1070,1090,1110,1130,1150,1170,1190,1210,1230,1250,1270,1290,1310,1330,1350,1370,1390,1410,1430,1450,1470,1490,1510,1530,1550,1570,1590,1610,1630,1650,1670,1690,1710,1730,1750,1770,1790,1810,1830,1850,1870,1890,1910,1930,1950,1970,1990,2010,2030,2050,2070,2090,2110,2130,2150,2170,2190,2210,2230,2250,2270,2290,2310,2330,2350,2370,2390,2410,2430,2450,2470,2490,2510,2530,2550,2570,2590,2610,2630,2650,2670,2690,2710,2730,2750,2770,2790,2810,2830,2850,2870,2890,2910,2930,2950,2970,2990,3010,3030,3050,3070,3090,3110,3130,3150,3170,3190,3210,3230,3250,3270,3290,3310,3330,3350,3370,3390,3410,3430,3450,3470,3490,3510,3530,3550,3570,3590,3610,3630,3650,3670,3690,3710,3730,3750,3770,3790,3810,3830,3850,3870,3890,3910,3930,3950,3970,3990,4010,4030,4050,4070,4090,4110,4130,4150,4170,4190,4210,4230,4250,4270,4290,4310,4330,4350,4370,4390,4410,4430,4450,4470,4490,4510,4530,4550,4570,4590,4610,4630,4650,4670,4690,4710,4730,4750,4770,4790,4810,4830,4850,4870,4890,4910,4930,4950,4970,4990,5010,5030,5050,5070,5090,5110,5130,5150,5170,5190,5210,5230,5250,5270,5290,5310,5330,5350,5370,5390,5410,5430,5450,5470,5490,5510,5530,5550,5570,5590,5610,5630,5650,5670,5690,5710,5730,5750,5770,5790,5810,5830,5850,5870,5890,5910,5930,5950,5970,5990,6010,6030,6050,6070,6090,6110,6130,6150,6170,6190,6210,6230,6250,6270,6290,6310,6330,6350,6370,6390,6410,6430,6450,6470,6490,6510,6530,6550,6570,6590,6610,6630,6650,6670,6690,6710,6730,6750,6770,6790,6810,6830,6850,6870,6890,6910,6930,6950,6970,6990,7010,7030,7050,7070,7090,7110,7130,7150,7170,7190,7210,7230,7250,7270,7290,7310,7330,7350,7370,7390,7410,7430,7450,7470,7490,7510,7530,7550,7570,7590,7610,7630,7650,7670,7690,7710,7730,7750,7770,7790,7810,7830,7850,7870,7890,7910,7930,7950,7970,7990,8010,8030,8050,8070,8090,8110,8130,8150,8170,8190,8210,8230,8250,8270,8290,8310,8330,8350,8370,8390,8410,8430,8450,8470,8490,8510,8530,8550,8570,8590,8610,8630,8650,8670,8690,8710,8730,8750,8770,8790,8810,8830,8850,8870,8890,8910,8930,8950,8970,8990,9010,9030,9050,9070,9090,9110,9130,9150,9170,9190,9210,9230,9250,9270,9290,9310,9330,9350,9370,9390,9410,9430,9450,9470,9490,9510,9530,9550,9570,9590,9610,9630,9650,9670,9690,9710,9730,9750,9770,9790,9810,9830,9850,9870,9890,9910,9930,9950,9970,9990,10010,10030,40050,40070,40090,40110,40130,40150,40170,40190,40210,40230,40250,40270,40290,40310,40330,40350,40370,40390,40410,40430,40450,40470,40490,40510,40530,40550,40570,40590,40610,40630,40650,40670,40690,40710,40730,40750,40770,40790,40810,40830,40850,40870,40890,40910,40930,40950,40970,40990,41010,41030,41050,41070,41090,41110,41130,41150,41170,41190,41210,41230,41250,41270,41290,41310,41330,41350,41370,41390,41410,41430,41450,41470,41490,41510,41530,41550,41570,41590,41610,41630,41650,41670,41690,41710,41730,41750,41770,41790,41810,41830,41850,41870,41890,41910,41930,41950,41970,41990,42010,42030,42050,42070,42090,42110,42130,42150,42170,42190,42210,42230,42250,42270,42290,42310,42330,42350,42370,42390,42410,42430,42450,42470,42490,42510,42530,42550,42570,42590,42610,42630,42650,42670,42690,42710,42730,42750,42770,42790,42810,42830,42850,42870,42890,42910,42930,42950,42970,42990,43010,43030,43050,43070,43090,43110,43130,43150,43170,43190,43210,43230,43250,43270,43290,43310,43330,43350,43370,43390,43410,43430,43450,43470,43490,43510,43530,43550,43570,43590,43610,43630,43650,43670,43690,43710,43730,43750,43770,43790,43810,43830,43850,43870,43890,43910,43930,43950,43970,43990,44010,44030,44050,44070,44090,44110,44130,44150,44170,44190,44210,44230,44250,44270,44290,44310,44330,44350,44370,44390,44410,44430,44450,44470,44490,44510,44530,44550,44570,44590,44610,44630,44650,44670,44690,44710,44730,44750,44770,44790,44810,44830,44850,44870,44890,44910,44930,44950,44970,44990,45010,45030,45050,45070,45090,45110,45130,45150,45170,45190,45210,45230,45250,45270,45290,45310,45330,45350,45370,45390,45410,45430,45450,45470,45490,45510,45530,45550,45570,45590,45610,45630,45650,45670,45690,45710,45730,45750,45770,45790,45810,45830,45850,45870,45890,45910,45930,45950,45970,45990,46010,46030,46050,46070,46090,46110,46130,46150,46170,46190,46210,46230,46250,46270,46290,46310,46330,46350,46370,46390,46410,46430,46450,46470,46490,46510,46530,46550,46570,46590,46610,46630,46650,46670,46690,46710,46730,46750,46770,46790,46810,46830,46850,46870,46890,46910,46930,46950,46970,46990,47010,47030,47050,47070,47090,47110,47130,47150,47170,47190,47210,47230,47250,47270,47290,47310,47330,47350,47370,47390,47410,47430,47450,47470,47490,47510,47530,47550,47570,47590,47610,47630,47650,47670,47690,47710,47730,47750,47770,47790,47810,47830,47850,47870,47890,47910,47930,47950,47970,47990,48010,48030,48050,48070,48090,48110,48130,48150,48170,48190,48210,48230,48250,48270,48290,48310,48330,48350,48370,48390,48410,48430,48450,48470,48490,48510,48530,48550,48570,48590,48610,48630,48650,48670,48690,48710,48730,48750,48770,48790,48810,48830,48850,48870,48890,48910,48930,48950,48970,48990,49010,49030,49050,49070,49090,49110,49130,49150,49170,49190,49210,49230,49250,49270,49290,49310,49330,49350,49370,49390,49410,49430,49450,49470,49490,49510,49530,49550,49570,49590,49610,49630,49650,49670,49690,49710,49730,49750,49770,49790,49810,49830,49850,49870,49890,49910,49930,49950,49970,49990,50010,50030],"media":[0,20,40,60,80,100,120,140,160,180,200,220,240,260,280,300,320,340,360,380,400,420,440,460,480,500,520,540,560,580,600,620,640,660,680,700,720,740,760,780,800,820,840,860,880,900,920,940,960,980,1000,1020,1040,1060,1080,1100,1120,1140,1160,1180,1200,1220,1240,1260,1280,1300,1320,1340,1360,1380,1400,1420,1440,1460,1480,1500,1520,1540,1560,1580,1600,1620,1640,1660,1680,1700,1720,1740,1760,1780,1800,1820,1840,1860,1880,1900,1920,1940,1960,1980,2000,2020,2040,2060,2080,2100,2120,2140,2160,2180,2200,2220,2240,2260,2280,2300,2320,2340,2360,2380,2400,2420,2440,2460,2480,2500,2520,2540,2560,2580,2600,2620,2640,2660,2680,2700,2720,2740,2760,2780,2800,2820,2840,2860,2880,2900,2920,2940,2960,2980,3000,3020,3040,3060,3080,3100,3120,3140,3160,3180,3200,3220,3240,3260,3280,3300,3320,3340,3360,3380,3400,3420,3440,3460,3480,3500,3520,3540,3560,3580,3600,3620,3640,3660,3680,3700,3720,3740,3760,3780,3800,3820,3840,3860,3880,3900,3920,3940,3960,3980,4000,4020,4040,4060,4080,4100,4120,4140,4160,4180,4200,4220,4240,4260,4280,4300,4320,4340,4360,4380,4400,4420,4440,4460,4480,4500,4520,4540,4560,4580,4600,4620,4640,4660,4680,4700,4720,4740,4760,4780,4800,4820,4840,4860,4880,4900,4920,4940,4960,4980,5000,5020,5040,5060,5080,5100,5120,5140,5160,5180,5200,5220,5240,5260,5280,5300,5320,5340,5360,5380,5400,5420,5440,5460,5480,5500,5520,5540,5560,5580,5600,5620,5640,5660,5680,5700,5720,5740,5760,5780,5800,5820,5840,5860,5880,5900,5920,5940,5960,5980,6000,6020,6040,6060,6080,6100,6120,6140,6160,6180,6200,6220,6240,6260,6280,6300,6320,6340,6360,6380,6400,6420,6440,6460,6480,6500,6520,6540,6560,6580,6600,6620,6640,6660,6680,6700,6720,6740,6760,6780,6800,6820,6840,6860,6880,6900,6920,6940,6960,6980,7000,7020,7040,7060,7080,7100,7120,7140,7160,7180,7200,7220,7240,7260,7280,7300,7320,7340,7360,7380,7400,7420,7440,7460,7480,7500,7520,7540,7560,7580,7600,7620,7640,7660,7680,7700,7720,7740,7760,7780,7800,7820,7840,7860,7880,7900,7920,7940,7960,7980,8000,8020,8040,8060,8080,8100,8120,8140,8160,8180,8200,8220,8240,8260,8280,8300,8320,8340,8360,8380,8400,8420,8440,8460,8480,8500,8520,8540,8560,8580,8600,8620,8640,8660,8680,8700,8720,8740,8760,8780,8800,8820,8840,8860,8880,8900,8920,8940,8960,8980,9000,9020,9040,9060,9080,9100,9120,9140,9160,9180,9200,9220,9240,9260,9280,9300,9320,9340,9360,9380,9400,9420,9440,9460,9480,9500,9520,9540,9560,9580,9600,9620,9640,9660,9680,9700,9720,9740,9760,9780,9800,9820,9840,9860,9880,9900,9920,9940,9960,9980,40000,40020,40040,40060,40080,40100,40120,40140,40160,40180,40200,40220,40240,40260,40280,40300,40320,40340,40360,40380,40400,40420,40440,40460,40480,40500,40520,40540,40560,40580,40600,40620,40640,40660,40680,40700,40720,40740,40760,40780,40800,40820,40840,40860,40880,40900,40920,40940,40960,40980,41000,41020,41040,41060,41080,41100,41120,41140,41160,41180,41200,41220,41240,41260,41280,41300,41320,41340,41360,41380,41400,41420,41440,41460,41480,41500,41520,41540,41560,41580,41600,41620,41640,41660,41680,41700,41720,41740,41760,41780,41800,41820,41840,41860,41880,41900,41920,41940,41960,41980,42000,42020,42040,42060,42080,42100,42120,42140,42160,42180,42200,42220,42240,42260,42280,42300,42320,42340,42360,42380,42400,42420,42440,42460,42480,42500,42520,42540,42560,42580,42600,42620,42640,42660,42680,42700,42720,42740,42760,42780,42800,42820,42840,42860,42880,42900,42920,42940,42960,42980,43000,43020,43040,43060,43080,43100,43120,43140,43160,43180,43200,43220,43240,43260,43280,43300,43320,43340,43360,43380,43400,43420,43440,43460,43480,43500,43520,43540,43560,43580,43600,43620,43640,43660,43680,43700,43720,43740,43760,43780,43800,43820,43840,43860,43880,43900,43920,43940,43960,43980,44000,44020,44040,44060,44080,44100,44120,44140,44160,44180,44200,44220,44240,44260,44280,44300,44320,44340,44360,44380,44400,44420,44440,44460,44480,44500,44520,44540,44560,44580,44600,44620,44640,44660,44680,44700,44720,44740,44760,44780,44800,44820,44840,44860,44880,44900,44920,44940,44960,44980,45000,45020,45040,45060,45080,45100,45120,45140,45160,45180,45200,45220,45240,45260,45280,45300,45320,45340,45360,45380,45400,45420,45440,45460,45480,45500,45520,45540,45560,45580,45600,45620,45640,45660,45680,45700,45720,45740,45760,45780,45800,45820,45840,45860,45880,45900,45920,45940,45960,45980,46000,46020,46040,46060,46080,46100,46120,46140,46160,46180,46200,46220,46240,46260,46280,46300,46320,46340,46360,46380,46400,46420,46440,46460,46480,46500,46520,46540,46560,46580,46600,46620,46640,46660,46680,46700,46720,46740,46760,46780,46800,46820,46840,46860,46880,46900,46920,46940,46960,46980,47000,47020,47040,47060,47080,47100,47120,47140,47160,47180,47200,47220,47240,47260,47280,47300,47320,47340,47360,47380,47400,47420,47440,47460,47480,47500,47520,47540,47560,47580,47600,47620,47640,47660,47680,47700,47720,47740,47760,47780,47800,47820,47840,47860,47880,47900,47920,47940,47960,47980,48000,48020,48040,48060,48080,48100,48120,48140,48160,48180,48200,48220,48240,48260,48280,48300,48320,48340,48360,48380,48400,48420,48440,48460,48480,48500,48520,48540,48560,48580,48600,48620,48640,48660,48680,48700,48720,48740,48760,48780,48800,48820,48840,48860,48880,48900,48920,48940,48960,48980,49000,49020,49040,49060,49080,49100,49120,49140,49160,49180,49200,49220,49240,49260,49280,49300,49320,49340,49360,49380,49400,49420,49440,49460,49480,49500,49520,49540,49560,49580,49600,49620,49640,49660,49680,49700,49720,49740,49760,49780,49800,49820,49840,49860,49880,49900,49920,49940,49960,49980],"target":[[0,120],[75,100],[175,80],[225,60],[250,40],[525,100],[575,80],[625,60],[675,40]]} diff --git a/doc/concept/audio-jitter/outage.json b/doc/concept/audio-jitter/outage.json new file mode 100644 index 00000000000..e6b16e80f53 --- /dev/null +++ b/doc/concept/audio-jitter/outage.json @@ -0,0 +1 @@ +{"name":"outage","about":"Even audio with a 1.5 s outage 10 s in: a queue serving one frame per 300 ms, then draining the backlog, so its delays climb past a second across four intervals. The frames stuck behind it are one stall, which folds once, so the one-off leaves the target where it was. So does a 1.5 s blackout 20 s in, recovering with the live edge before its backlog, whose empty intervals belong to the stall that ends them. Three more outages 3 s apart from 30 s still raise it, and it decays once they stop.","frame":20,"arrival":[50,70,90,110,130,150,170,190,210,230,250,270,290,310,330,350,370,390,410,430,450,470,490,510,530,550,570,590,610,630,650,670,690,710,730,750,770,790,810,830,850,870,890,910,930,950,970,990,1010,1030,1050,1070,1090,1110,1130,1150,1170,1190,1210,1230,1250,1270,1290,1310,1330,1350,1370,1390,1410,1430,1450,1470,1490,1510,1530,1550,1570,1590,1610,1630,1650,1670,1690,1710,1730,1750,1770,1790,1810,1830,1850,1870,1890,1910,1930,1950,1970,1990,2010,2030,2050,2070,2090,2110,2130,2150,2170,2190,2210,2230,2250,2270,2290,2310,2330,2350,2370,2390,2410,2430,2450,2470,2490,2510,2530,2550,2570,2590,2610,2630,2650,2670,2690,2710,2730,2750,2770,2790,2810,2830,2850,2870,2890,2910,2930,2950,2970,2990,3010,3030,3050,3070,3090,3110,3130,3150,3170,3190,3210,3230,3250,3270,3290,3310,3330,3350,3370,3390,3410,3430,3450,3470,3490,3510,3530,3550,3570,3590,3610,3630,3650,3670,3690,3710,3730,3750,3770,3790,3810,3830,3850,3870,3890,3910,3930,3950,3970,3990,4010,4030,4050,4070,4090,4110,4130,4150,4170,4190,4210,4230,4250,4270,4290,4310,4330,4350,4370,4390,4410,4430,4450,4470,4490,4510,4530,4550,4570,4590,4610,4630,4650,4670,4690,4710,4730,4750,4770,4790,4810,4830,4850,4870,4890,4910,4930,4950,4970,4990,5010,5030,5050,5070,5090,5110,5130,5150,5170,5190,5210,5230,5250,5270,5290,5310,5330,5350,5370,5390,5410,5430,5450,5470,5490,5510,5530,5550,5570,5590,5610,5630,5650,5670,5690,5710,5730,5750,5770,5790,5810,5830,5850,5870,5890,5910,5930,5950,5970,5990,6010,6030,6050,6070,6090,6110,6130,6150,6170,6190,6210,6230,6250,6270,6290,6310,6330,6350,6370,6390,6410,6430,6450,6470,6490,6510,6530,6550,6570,6590,6610,6630,6650,6670,6690,6710,6730,6750,6770,6790,6810,6830,6850,6870,6890,6910,6930,6950,6970,6990,7010,7030,7050,7070,7090,7110,7130,7150,7170,7190,7210,7230,7250,7270,7290,7310,7330,7350,7370,7390,7410,7430,7450,7470,7490,7510,7530,7550,7570,7590,7610,7630,7650,7670,7690,7710,7730,7750,7770,7790,7810,7830,7850,7870,7890,7910,7930,7950,7970,7990,8010,8030,8050,8070,8090,8110,8130,8150,8170,8190,8210,8230,8250,8270,8290,8310,8330,8350,8370,8390,8410,8430,8450,8470,8490,8510,8530,8550,8570,8590,8610,8630,8650,8670,8690,8710,8730,8750,8770,8790,8810,8830,8850,8870,8890,8910,8930,8950,8970,8990,9010,9030,9050,9070,9090,9110,9130,9150,9170,9190,9210,9230,9250,9270,9290,9310,9330,9350,9370,9390,9410,9430,9450,9470,9490,9510,9530,9550,9570,9590,9610,9630,9650,9670,9690,9710,9730,9750,9770,9790,9810,9830,9850,9870,9890,9910,9930,9950,9970,9990,10010,10030,10350,10650,10950,11250,11550,11552,11554,11556,11558,11560,11562,11564,11566,11568,11570,11572,11574,11576,11578,11580,11582,11584,11586,11588,11590,11592,11594,11596,11598,11600,11602,11604,11606,11608,11610,11612,11614,11616,11618,11620,11622,11624,11626,11628,11630,11632,11634,11636,11638,11640,11642,11644,11646,11648,11650,11652,11654,11656,11658,11660,11662,11664,11666,11668,11670,11672,11674,11676,11678,11680,11682,11684,11686,11688,11690,11692,11694,11696,11698,11700,11702,11704,11706,11710,11730,11750,11770,11790,11810,11830,11850,11870,11890,11910,11930,11950,11970,11990,12010,12030,12050,12070,12090,12110,12130,12150,12170,12190,12210,12230,12250,12270,12290,12310,12330,12350,12370,12390,12410,12430,12450,12470,12490,12510,12530,12550,12570,12590,12610,12630,12650,12670,12690,12710,12730,12750,12770,12790,12810,12830,12850,12870,12890,12910,12930,12950,12970,12990,13010,13030,13050,13070,13090,13110,13130,13150,13170,13190,13210,13230,13250,13270,13290,13310,13330,13350,13370,13390,13410,13430,13450,13470,13490,13510,13530,13550,13570,13590,13610,13630,13650,13670,13690,13710,13730,13750,13770,13790,13810,13830,13850,13870,13890,13910,13930,13950,13970,13990,14010,14030,14050,14070,14090,14110,14130,14150,14170,14190,14210,14230,14250,14270,14290,14310,14330,14350,14370,14390,14410,14430,14450,14470,14490,14510,14530,14550,14570,14590,14610,14630,14650,14670,14690,14710,14730,14750,14770,14790,14810,14830,14850,14870,14890,14910,14930,14950,14970,14990,15010,15030,15050,15070,15090,15110,15130,15150,15170,15190,15210,15230,15250,15270,15290,15310,15330,15350,15370,15390,15410,15430,15450,15470,15490,15510,15530,15550,15570,15590,15610,15630,15650,15670,15690,15710,15730,15750,15770,15790,15810,15830,15850,15870,15890,15910,15930,15950,15970,15990,16010,16030,16050,16070,16090,16110,16130,16150,16170,16190,16210,16230,16250,16270,16290,16310,16330,16350,16370,16390,16410,16430,16450,16470,16490,16510,16530,16550,16570,16590,16610,16630,16650,16670,16690,16710,16730,16750,16770,16790,16810,16830,16850,16870,16890,16910,16930,16950,16970,16990,17010,17030,17050,17070,17090,17110,17130,17150,17170,17190,17210,17230,17250,17270,17290,17310,17330,17350,17370,17390,17410,17430,17450,17470,17490,17510,17530,17550,17570,17590,17610,17630,17650,17670,17690,17710,17730,17750,17770,17790,17810,17830,17850,17870,17890,17910,17930,17950,17970,17990,18010,18030,18050,18070,18090,18110,18130,18150,18170,18190,18210,18230,18250,18270,18290,18310,18330,18350,18370,18390,18410,18430,18450,18470,18490,18510,18530,18550,18570,18590,18610,18630,18650,18670,18690,18710,18730,18750,18770,18790,18810,18830,18850,18870,18890,18910,18930,18950,18970,18990,19010,19030,19050,19070,19090,19110,19130,19150,19170,19190,19210,19230,19250,19270,19290,19310,19330,19350,19370,19390,19410,19430,19450,19470,19490,19510,19530,19550,19570,19590,19610,19630,19650,19670,19690,19710,19730,19750,19770,19790,19810,19830,19850,19870,19890,19910,19930,19950,19970,19990,20010,20030,21550,21550,21552,21554,21556,21558,21560,21562,21564,21566,21568,21570,21572,21574,21576,21578,21580,21582,21584,21586,21588,21590,21592,21594,21596,21598,21600,21602,21604,21606,21608,21610,21612,21614,21616,21618,21620,21622,21624,21626,21628,21630,21632,21634,21636,21638,21640,21642,21644,21646,21648,21650,21652,21654,21656,21658,21660,21662,21664,21666,21668,21670,21672,21674,21676,21678,21680,21682,21684,21686,21688,21690,21692,21694,21696,21698,21702,21704,21706,21708,21710,21712,21714,21716,21730,21750,21770,21790,21810,21830,21850,21870,21890,21910,21930,21950,21970,21990,22010,22030,22050,22070,22090,22110,22130,22150,22170,22190,22210,22230,22250,22270,22290,22310,22330,22350,22370,22390,22410,22430,22450,22470,22490,22510,22530,22550,22570,22590,22610,22630,22650,22670,22690,22710,22730,22750,22770,22790,22810,22830,22850,22870,22890,22910,22930,22950,22970,22990,23010,23030,23050,23070,23090,23110,23130,23150,23170,23190,23210,23230,23250,23270,23290,23310,23330,23350,23370,23390,23410,23430,23450,23470,23490,23510,23530,23550,23570,23590,23610,23630,23650,23670,23690,23710,23730,23750,23770,23790,23810,23830,23850,23870,23890,23910,23930,23950,23970,23990,24010,24030,24050,24070,24090,24110,24130,24150,24170,24190,24210,24230,24250,24270,24290,24310,24330,24350,24370,24390,24410,24430,24450,24470,24490,24510,24530,24550,24570,24590,24610,24630,24650,24670,24690,24710,24730,24750,24770,24790,24810,24830,24850,24870,24890,24910,24930,24950,24970,24990,25010,25030,25050,25070,25090,25110,25130,25150,25170,25190,25210,25230,25250,25270,25290,25310,25330,25350,25370,25390,25410,25430,25450,25470,25490,25510,25530,25550,25570,25590,25610,25630,25650,25670,25690,25710,25730,25750,25770,25790,25810,25830,25850,25870,25890,25910,25930,25950,25970,25990,26010,26030,26050,26070,26090,26110,26130,26150,26170,26190,26210,26230,26250,26270,26290,26310,26330,26350,26370,26390,26410,26430,26450,26470,26490,26510,26530,26550,26570,26590,26610,26630,26650,26670,26690,26710,26730,26750,26770,26790,26810,26830,26850,26870,26890,26910,26930,26950,26970,26990,27010,27030,27050,27070,27090,27110,27130,27150,27170,27190,27210,27230,27250,27270,27290,27310,27330,27350,27370,27390,27410,27430,27450,27470,27490,27510,27530,27550,27570,27590,27610,27630,27650,27670,27690,27710,27730,27750,27770,27790,27810,27830,27850,27870,27890,27910,27930,27950,27970,27990,28010,28030,28050,28070,28090,28110,28130,28150,28170,28190,28210,28230,28250,28270,28290,28310,28330,28350,28370,28390,28410,28430,28450,28470,28490,28510,28530,28550,28570,28590,28610,28630,28650,28670,28690,28710,28730,28750,28770,28790,28810,28830,28850,28870,28890,28910,28930,28950,28970,28990,29010,29030,29050,29070,29090,29110,29130,29150,29170,29190,29210,29230,29250,29270,29290,29310,29330,29350,29370,29390,29410,29430,29450,29470,29490,29510,29530,29550,29570,29590,29610,29630,29650,29670,29690,29710,29730,29750,29770,29790,29810,29830,29850,29870,29890,29910,29930,29950,29970,29990,30010,30030,30350,30650,30950,31250,31550,31552,31554,31556,31558,31560,31562,31564,31566,31568,31570,31572,31574,31576,31578,31580,31582,31584,31586,31588,31590,31592,31594,31596,31598,31600,31602,31604,31606,31608,31610,31612,31614,31616,31618,31620,31622,31624,31626,31628,31630,31632,31634,31636,31638,31640,31642,31644,31646,31648,31650,31652,31654,31656,31658,31660,31662,31664,31666,31668,31670,31672,31674,31676,31678,31680,31682,31684,31686,31688,31690,31692,31694,31696,31698,31700,31702,31704,31706,31710,31730,31750,31770,31790,31810,31830,31850,31870,31890,31910,31930,31950,31970,31990,32010,32030,32050,32070,32090,32110,32130,32150,32170,32190,32210,32230,32250,32270,32290,32310,32330,32350,32370,32390,32410,32430,32450,32470,32490,32510,32530,32550,32570,32590,32610,32630,32650,32670,32690,32710,32730,32750,32770,32790,32810,32830,32850,32870,32890,32910,32930,32950,32970,32990,33010,33030,33350,33650,33950,34250,34550,34552,34554,34556,34558,34560,34562,34564,34566,34568,34570,34572,34574,34576,34578,34580,34582,34584,34586,34588,34590,34592,34594,34596,34598,34600,34602,34604,34606,34608,34610,34612,34614,34616,34618,34620,34622,34624,34626,34628,34630,34632,34634,34636,34638,34640,34642,34644,34646,34648,34650,34652,34654,34656,34658,34660,34662,34664,34666,34668,34670,34672,34674,34676,34678,34680,34682,34684,34686,34688,34690,34692,34694,34696,34698,34700,34702,34704,34706,34710,34730,34750,34770,34790,34810,34830,34850,34870,34890,34910,34930,34950,34970,34990,35010,35030,35050,35070,35090,35110,35130,35150,35170,35190,35210,35230,35250,35270,35290,35310,35330,35350,35370,35390,35410,35430,35450,35470,35490,35510,35530,35550,35570,35590,35610,35630,35650,35670,35690,35710,35730,35750,35770,35790,35810,35830,35850,35870,35890,35910,35930,35950,35970,35990,36010,36030,36350,36650,36950,37250,37550,37552,37554,37556,37558,37560,37562,37564,37566,37568,37570,37572,37574,37576,37578,37580,37582,37584,37586,37588,37590,37592,37594,37596,37598,37600,37602,37604,37606,37608,37610,37612,37614,37616,37618,37620,37622,37624,37626,37628,37630,37632,37634,37636,37638,37640,37642,37644,37646,37648,37650,37652,37654,37656,37658,37660,37662,37664,37666,37668,37670,37672,37674,37676,37678,37680,37682,37684,37686,37688,37690,37692,37694,37696,37698,37700,37702,37704,37706,37710,37730,37750,37770,37790,37810,37830,37850,37870,37890,37910,37930,37950,37970,37990,38010,38030,38050,38070,38090,38110,38130,38150,38170,38190,38210,38230,38250,38270,38290,38310,38330,38350,38370,38390,38410,38430,38450,38470,38490,38510,38530,38550,38570,38590,38610,38630,38650,38670,38690,38710,38730,38750,38770,38790,38810,38830,38850,38870,38890,38910,38930,38950,38970,38990,39010,39030,39050,39070,39090,39110,39130,39150,39170,39190,39210,39230,39250,39270,39290,39310,39330,39350,39370,39390,39410,39430,39450,39470,39490,39510,39530,39550,39570,39590,39610,39630,39650,39670,39690,39710,39730,39750,39770,39790,39810,39830,39850,39870,39890,39910,39930,39950,39970,39990,40010,40030,40050,40070,40090,40110,40130,40150,40170,40190,40210,40230,40250,40270,40290,40310,40330,40350,40370,40390,40410,40430,40450,40470,40490,40510,40530,40550,40570,40590,40610,40630,40650,40670,40690,40710,40730,40750,40770,40790,40810,40830,40850,40870,40890,40910,40930,40950,40970,40990,41010,41030,41050,41070,41090,41110,41130,41150,41170,41190,41210,41230,41250,41270,41290,41310,41330,41350,41370,41390,41410,41430,41450,41470,41490,41510,41530,41550,41570,41590,41610,41630,41650,41670,41690,41710,41730,41750,41770,41790,41810,41830,41850,41870,41890,41910,41930,41950,41970,41990,42010,42030,42050,42070,42090,42110,42130,42150,42170,42190,42210,42230,42250,42270,42290,42310,42330,42350,42370,42390,42410,42430,42450,42470,42490,42510,42530,42550,42570,42590,42610,42630,42650,42670,42690,42710,42730,42750,42770,42790,42810,42830,42850,42870,42890,42910,42930,42950,42970,42990,43010,43030,43050,43070,43090,43110,43130,43150,43170,43190,43210,43230,43250,43270,43290,43310,43330,43350,43370,43390,43410,43430,43450,43470,43490,43510,43530,43550,43570,43590,43610,43630,43650,43670,43690,43710,43730,43750,43770,43790,43810,43830,43850,43870,43890,43910,43930,43950,43970,43990,44010,44030,44050,44070,44090,44110,44130,44150,44170,44190,44210,44230,44250,44270,44290,44310,44330,44350,44370,44390,44410,44430,44450,44470,44490,44510,44530,44550,44570,44590,44610,44630,44650,44670,44690,44710,44730,44750,44770,44790,44810,44830,44850,44870,44890,44910,44930,44950,44970,44990,45010,45030,45050,45070,45090,45110,45130,45150,45170,45190,45210,45230,45250,45270,45290,45310,45330,45350,45370,45390,45410,45430,45450,45470,45490,45510,45530,45550,45570,45590,45610,45630,45650,45670,45690,45710,45730,45750,45770,45790,45810,45830,45850,45870,45890,45910,45930,45950,45970,45990,46010,46030,46050,46070,46090,46110,46130,46150,46170,46190,46210,46230,46250,46270,46290,46310,46330,46350,46370,46390,46410,46430,46450,46470,46490,46510,46530,46550,46570,46590,46610,46630,46650,46670,46690,46710,46730,46750,46770,46790,46810,46830,46850,46870,46890,46910,46930,46950,46970,46990,47010,47030,47050,47070,47090,47110,47130,47150,47170,47190,47210,47230,47250,47270,47290,47310,47330,47350,47370,47390,47410,47430,47450,47470,47490,47510,47530,47550,47570,47590,47610,47630,47650,47670,47690,47710,47730,47750,47770,47790,47810,47830,47850,47870,47890,47910,47930,47950,47970,47990,48010,48030,48050,48070,48090,48110,48130,48150,48170,48190,48210,48230,48250,48270,48290,48310,48330,48350,48370,48390,48410,48430,48450,48470,48490,48510,48530,48550,48570,48590,48610,48630,48650,48670,48690,48710,48730,48750,48770,48790,48810,48830,48850,48870,48890,48910,48930,48950,48970,48990,49010,49030,49050,49070,49090,49110,49130,49150,49170,49190,49210,49230,49250,49270,49290,49310,49330,49350,49370,49390,49410,49430,49450,49470,49490,49510,49530,49550,49570,49590,49610,49630,49650,49670,49690,49710,49730,49750,49770,49790,49810,49830,49850,49870,49890,49910,49930,49950,49970,49990,50010,50030,50050,50070,50090,50110,50130,50150,50170,50190,50210,50230,50250,50270,50290,50310,50330,50350,50370,50390,50410,50430,50450,50470,50490,50510,50530,50550,50570,50590,50610,50630,50650,50670,50690,50710,50730,50750,50770,50790,50810,50830,50850,50870,50890,50910,50930,50950,50970,50990,51010,51030,51050,51070,51090,51110,51130,51150,51170,51190,51210,51230,51250,51270,51290,51310,51330,51350,51370,51390,51410,51430,51450,51470,51490,51510,51530,51550,51570,51590,51610,51630,51650,51670,51690,51710,51730,51750,51770,51790,51810,51830,51850,51870,51890,51910,51930,51950,51970,51990,52010,52030,52050,52070,52090,52110,52130,52150,52170,52190,52210,52230,52250,52270,52290,52310,52330,52350,52370,52390,52410,52430,52450,52470,52490,52510,52530,52550,52570,52590,52610,52630,52650,52670,52690,52710,52730,52750,52770,52790,52810,52830,52850,52870,52890,52910,52930,52950,52970,52990,53010,53030,53050,53070,53090,53110,53130,53150,53170,53190,53210,53230,53250,53270,53290,53310,53330,53350,53370,53390,53410,53430,53450,53470,53490,53510,53530,53550,53570,53590,53610,53630,53650,53670,53690,53710,53730,53750,53770,53790,53810,53830,53850,53870,53890,53910,53930,53950,53970,53990,54010,54030,54050,54070,54090,54110,54130,54150,54170,54190,54210,54230,54250,54270,54290,54310,54330,54350,54370,54390,54410,54430,54450,54470,54490,54510,54530,54550,54570,54590,54610,54630,54650,54670,54690,54710,54730,54750,54770,54790,54810,54830,54850,54870,54890,54910,54930,54950,54970,54990,55010,55030,55050,55070,55090,55110,55130,55150,55170,55190,55210,55230,55250,55270,55290,55310,55330,55350,55370,55390,55410,55430,55450,55470,55490,55510,55530,55550,55570,55590,55610,55630,55650,55670,55690,55710,55730,55750,55770,55790,55810,55830,55850,55870,55890,55910,55930,55950,55970,55990,56010,56030,56050,56070,56090,56110,56130,56150,56170,56190,56210,56230,56250,56270,56290,56310,56330,56350,56370,56390,56410,56430,56450,56470,56490,56510,56530,56550,56570,56590,56610,56630,56650,56670,56690,56710,56730,56750,56770,56790,56810,56830,56850,56870,56890,56910,56930,56950,56970,56990,57010,57030,57050,57070,57090,57110,57130,57150,57170,57190,57210,57230,57250,57270,57290,57310,57330,57350,57370,57390,57410,57430,57450,57470,57490,57510,57530,57550,57570,57590,57610,57630,57650,57670,57690,57710,57730,57750,57770,57790,57810,57830,57850,57870,57890,57910,57930,57950,57970,57990,58010,58030,58050,58070,58090,58110,58130,58150,58170,58190,58210,58230,58250,58270,58290,58310,58330,58350,58370,58390,58410,58430,58450,58470,58490,58510,58530,58550,58570,58590,58610,58630,58650,58670,58690,58710,58730,58750,58770,58790,58810,58830,58850,58870,58890,58910,58930,58950,58970,58990,59010,59030,59050,59070,59090,59110,59130,59150,59170,59190,59210,59230,59250,59270,59290,59310,59330,59350,59370,59390,59410,59430,59450,59470,59490,59510,59530,59550,59570,59590,59610,59630,59650,59670,59690,59710,59730,59750,59770,59790,59810,59830,59850,59870,59890,59910,59930,59950,59970,59990,60010,60030],"media":[0,20,40,60,80,100,120,140,160,180,200,220,240,260,280,300,320,340,360,380,400,420,440,460,480,500,520,540,560,580,600,620,640,660,680,700,720,740,760,780,800,820,840,860,880,900,920,940,960,980,1000,1020,1040,1060,1080,1100,1120,1140,1160,1180,1200,1220,1240,1260,1280,1300,1320,1340,1360,1380,1400,1420,1440,1460,1480,1500,1520,1540,1560,1580,1600,1620,1640,1660,1680,1700,1720,1740,1760,1780,1800,1820,1840,1860,1880,1900,1920,1940,1960,1980,2000,2020,2040,2060,2080,2100,2120,2140,2160,2180,2200,2220,2240,2260,2280,2300,2320,2340,2360,2380,2400,2420,2440,2460,2480,2500,2520,2540,2560,2580,2600,2620,2640,2660,2680,2700,2720,2740,2760,2780,2800,2820,2840,2860,2880,2900,2920,2940,2960,2980,3000,3020,3040,3060,3080,3100,3120,3140,3160,3180,3200,3220,3240,3260,3280,3300,3320,3340,3360,3380,3400,3420,3440,3460,3480,3500,3520,3540,3560,3580,3600,3620,3640,3660,3680,3700,3720,3740,3760,3780,3800,3820,3840,3860,3880,3900,3920,3940,3960,3980,4000,4020,4040,4060,4080,4100,4120,4140,4160,4180,4200,4220,4240,4260,4280,4300,4320,4340,4360,4380,4400,4420,4440,4460,4480,4500,4520,4540,4560,4580,4600,4620,4640,4660,4680,4700,4720,4740,4760,4780,4800,4820,4840,4860,4880,4900,4920,4940,4960,4980,5000,5020,5040,5060,5080,5100,5120,5140,5160,5180,5200,5220,5240,5260,5280,5300,5320,5340,5360,5380,5400,5420,5440,5460,5480,5500,5520,5540,5560,5580,5600,5620,5640,5660,5680,5700,5720,5740,5760,5780,5800,5820,5840,5860,5880,5900,5920,5940,5960,5980,6000,6020,6040,6060,6080,6100,6120,6140,6160,6180,6200,6220,6240,6260,6280,6300,6320,6340,6360,6380,6400,6420,6440,6460,6480,6500,6520,6540,6560,6580,6600,6620,6640,6660,6680,6700,6720,6740,6760,6780,6800,6820,6840,6860,6880,6900,6920,6940,6960,6980,7000,7020,7040,7060,7080,7100,7120,7140,7160,7180,7200,7220,7240,7260,7280,7300,7320,7340,7360,7380,7400,7420,7440,7460,7480,7500,7520,7540,7560,7580,7600,7620,7640,7660,7680,7700,7720,7740,7760,7780,7800,7820,7840,7860,7880,7900,7920,7940,7960,7980,8000,8020,8040,8060,8080,8100,8120,8140,8160,8180,8200,8220,8240,8260,8280,8300,8320,8340,8360,8380,8400,8420,8440,8460,8480,8500,8520,8540,8560,8580,8600,8620,8640,8660,8680,8700,8720,8740,8760,8780,8800,8820,8840,8860,8880,8900,8920,8940,8960,8980,9000,9020,9040,9060,9080,9100,9120,9140,9160,9180,9200,9220,9240,9260,9280,9300,9320,9340,9360,9380,9400,9420,9440,9460,9480,9500,9520,9540,9560,9580,9600,9620,9640,9660,9680,9700,9720,9740,9760,9780,9800,9820,9840,9860,9880,9900,9920,9940,9960,9980,10000,10020,10040,10060,10080,10100,10120,10140,10160,10180,10200,10220,10240,10260,10280,10300,10320,10340,10360,10380,10400,10420,10440,10460,10480,10500,10520,10540,10560,10580,10600,10620,10640,10660,10680,10700,10720,10740,10760,10780,10800,10820,10840,10860,10880,10900,10920,10940,10960,10980,11000,11020,11040,11060,11080,11100,11120,11140,11160,11180,11200,11220,11240,11260,11280,11300,11320,11340,11360,11380,11400,11420,11440,11460,11480,11500,11520,11540,11560,11580,11600,11620,11640,11660,11680,11700,11720,11740,11760,11780,11800,11820,11840,11860,11880,11900,11920,11940,11960,11980,12000,12020,12040,12060,12080,12100,12120,12140,12160,12180,12200,12220,12240,12260,12280,12300,12320,12340,12360,12380,12400,12420,12440,12460,12480,12500,12520,12540,12560,12580,12600,12620,12640,12660,12680,12700,12720,12740,12760,12780,12800,12820,12840,12860,12880,12900,12920,12940,12960,12980,13000,13020,13040,13060,13080,13100,13120,13140,13160,13180,13200,13220,13240,13260,13280,13300,13320,13340,13360,13380,13400,13420,13440,13460,13480,13500,13520,13540,13560,13580,13600,13620,13640,13660,13680,13700,13720,13740,13760,13780,13800,13820,13840,13860,13880,13900,13920,13940,13960,13980,14000,14020,14040,14060,14080,14100,14120,14140,14160,14180,14200,14220,14240,14260,14280,14300,14320,14340,14360,14380,14400,14420,14440,14460,14480,14500,14520,14540,14560,14580,14600,14620,14640,14660,14680,14700,14720,14740,14760,14780,14800,14820,14840,14860,14880,14900,14920,14940,14960,14980,15000,15020,15040,15060,15080,15100,15120,15140,15160,15180,15200,15220,15240,15260,15280,15300,15320,15340,15360,15380,15400,15420,15440,15460,15480,15500,15520,15540,15560,15580,15600,15620,15640,15660,15680,15700,15720,15740,15760,15780,15800,15820,15840,15860,15880,15900,15920,15940,15960,15980,16000,16020,16040,16060,16080,16100,16120,16140,16160,16180,16200,16220,16240,16260,16280,16300,16320,16340,16360,16380,16400,16420,16440,16460,16480,16500,16520,16540,16560,16580,16600,16620,16640,16660,16680,16700,16720,16740,16760,16780,16800,16820,16840,16860,16880,16900,16920,16940,16960,16980,17000,17020,17040,17060,17080,17100,17120,17140,17160,17180,17200,17220,17240,17260,17280,17300,17320,17340,17360,17380,17400,17420,17440,17460,17480,17500,17520,17540,17560,17580,17600,17620,17640,17660,17680,17700,17720,17740,17760,17780,17800,17820,17840,17860,17880,17900,17920,17940,17960,17980,18000,18020,18040,18060,18080,18100,18120,18140,18160,18180,18200,18220,18240,18260,18280,18300,18320,18340,18360,18380,18400,18420,18440,18460,18480,18500,18520,18540,18560,18580,18600,18620,18640,18660,18680,18700,18720,18740,18760,18780,18800,18820,18840,18860,18880,18900,18920,18940,18960,18980,19000,19020,19040,19060,19080,19100,19120,19140,19160,19180,19200,19220,19240,19260,19280,19300,19320,19340,19360,19380,19400,19420,19440,19460,19480,19500,19520,19540,19560,19580,19600,19620,19640,19660,19680,19700,19720,19740,19760,19780,19800,19820,19840,19860,19880,19900,19920,19940,19960,19980,21500,20000,20020,20040,20060,20080,20100,20120,20140,20160,20180,20200,20220,20240,20260,20280,20300,20320,20340,20360,20380,20400,20420,20440,20460,20480,20500,20520,20540,20560,20580,20600,20620,20640,20660,20680,20700,20720,20740,20760,20780,20800,20820,20840,20860,20880,20900,20920,20940,20960,20980,21000,21020,21040,21060,21080,21100,21120,21140,21160,21180,21200,21220,21240,21260,21280,21300,21320,21340,21360,21380,21400,21420,21440,21460,21480,21520,21540,21560,21580,21600,21620,21640,21660,21680,21700,21720,21740,21760,21780,21800,21820,21840,21860,21880,21900,21920,21940,21960,21980,22000,22020,22040,22060,22080,22100,22120,22140,22160,22180,22200,22220,22240,22260,22280,22300,22320,22340,22360,22380,22400,22420,22440,22460,22480,22500,22520,22540,22560,22580,22600,22620,22640,22660,22680,22700,22720,22740,22760,22780,22800,22820,22840,22860,22880,22900,22920,22940,22960,22980,23000,23020,23040,23060,23080,23100,23120,23140,23160,23180,23200,23220,23240,23260,23280,23300,23320,23340,23360,23380,23400,23420,23440,23460,23480,23500,23520,23540,23560,23580,23600,23620,23640,23660,23680,23700,23720,23740,23760,23780,23800,23820,23840,23860,23880,23900,23920,23940,23960,23980,24000,24020,24040,24060,24080,24100,24120,24140,24160,24180,24200,24220,24240,24260,24280,24300,24320,24340,24360,24380,24400,24420,24440,24460,24480,24500,24520,24540,24560,24580,24600,24620,24640,24660,24680,24700,24720,24740,24760,24780,24800,24820,24840,24860,24880,24900,24920,24940,24960,24980,25000,25020,25040,25060,25080,25100,25120,25140,25160,25180,25200,25220,25240,25260,25280,25300,25320,25340,25360,25380,25400,25420,25440,25460,25480,25500,25520,25540,25560,25580,25600,25620,25640,25660,25680,25700,25720,25740,25760,25780,25800,25820,25840,25860,25880,25900,25920,25940,25960,25980,26000,26020,26040,26060,26080,26100,26120,26140,26160,26180,26200,26220,26240,26260,26280,26300,26320,26340,26360,26380,26400,26420,26440,26460,26480,26500,26520,26540,26560,26580,26600,26620,26640,26660,26680,26700,26720,26740,26760,26780,26800,26820,26840,26860,26880,26900,26920,26940,26960,26980,27000,27020,27040,27060,27080,27100,27120,27140,27160,27180,27200,27220,27240,27260,27280,27300,27320,27340,27360,27380,27400,27420,27440,27460,27480,27500,27520,27540,27560,27580,27600,27620,27640,27660,27680,27700,27720,27740,27760,27780,27800,27820,27840,27860,27880,27900,27920,27940,27960,27980,28000,28020,28040,28060,28080,28100,28120,28140,28160,28180,28200,28220,28240,28260,28280,28300,28320,28340,28360,28380,28400,28420,28440,28460,28480,28500,28520,28540,28560,28580,28600,28620,28640,28660,28680,28700,28720,28740,28760,28780,28800,28820,28840,28860,28880,28900,28920,28940,28960,28980,29000,29020,29040,29060,29080,29100,29120,29140,29160,29180,29200,29220,29240,29260,29280,29300,29320,29340,29360,29380,29400,29420,29440,29460,29480,29500,29520,29540,29560,29580,29600,29620,29640,29660,29680,29700,29720,29740,29760,29780,29800,29820,29840,29860,29880,29900,29920,29940,29960,29980,30000,30020,30040,30060,30080,30100,30120,30140,30160,30180,30200,30220,30240,30260,30280,30300,30320,30340,30360,30380,30400,30420,30440,30460,30480,30500,30520,30540,30560,30580,30600,30620,30640,30660,30680,30700,30720,30740,30760,30780,30800,30820,30840,30860,30880,30900,30920,30940,30960,30980,31000,31020,31040,31060,31080,31100,31120,31140,31160,31180,31200,31220,31240,31260,31280,31300,31320,31340,31360,31380,31400,31420,31440,31460,31480,31500,31520,31540,31560,31580,31600,31620,31640,31660,31680,31700,31720,31740,31760,31780,31800,31820,31840,31860,31880,31900,31920,31940,31960,31980,32000,32020,32040,32060,32080,32100,32120,32140,32160,32180,32200,32220,32240,32260,32280,32300,32320,32340,32360,32380,32400,32420,32440,32460,32480,32500,32520,32540,32560,32580,32600,32620,32640,32660,32680,32700,32720,32740,32760,32780,32800,32820,32840,32860,32880,32900,32920,32940,32960,32980,33000,33020,33040,33060,33080,33100,33120,33140,33160,33180,33200,33220,33240,33260,33280,33300,33320,33340,33360,33380,33400,33420,33440,33460,33480,33500,33520,33540,33560,33580,33600,33620,33640,33660,33680,33700,33720,33740,33760,33780,33800,33820,33840,33860,33880,33900,33920,33940,33960,33980,34000,34020,34040,34060,34080,34100,34120,34140,34160,34180,34200,34220,34240,34260,34280,34300,34320,34340,34360,34380,34400,34420,34440,34460,34480,34500,34520,34540,34560,34580,34600,34620,34640,34660,34680,34700,34720,34740,34760,34780,34800,34820,34840,34860,34880,34900,34920,34940,34960,34980,35000,35020,35040,35060,35080,35100,35120,35140,35160,35180,35200,35220,35240,35260,35280,35300,35320,35340,35360,35380,35400,35420,35440,35460,35480,35500,35520,35540,35560,35580,35600,35620,35640,35660,35680,35700,35720,35740,35760,35780,35800,35820,35840,35860,35880,35900,35920,35940,35960,35980,36000,36020,36040,36060,36080,36100,36120,36140,36160,36180,36200,36220,36240,36260,36280,36300,36320,36340,36360,36380,36400,36420,36440,36460,36480,36500,36520,36540,36560,36580,36600,36620,36640,36660,36680,36700,36720,36740,36760,36780,36800,36820,36840,36860,36880,36900,36920,36940,36960,36980,37000,37020,37040,37060,37080,37100,37120,37140,37160,37180,37200,37220,37240,37260,37280,37300,37320,37340,37360,37380,37400,37420,37440,37460,37480,37500,37520,37540,37560,37580,37600,37620,37640,37660,37680,37700,37720,37740,37760,37780,37800,37820,37840,37860,37880,37900,37920,37940,37960,37980,38000,38020,38040,38060,38080,38100,38120,38140,38160,38180,38200,38220,38240,38260,38280,38300,38320,38340,38360,38380,38400,38420,38440,38460,38480,38500,38520,38540,38560,38580,38600,38620,38640,38660,38680,38700,38720,38740,38760,38780,38800,38820,38840,38860,38880,38900,38920,38940,38960,38980,39000,39020,39040,39060,39080,39100,39120,39140,39160,39180,39200,39220,39240,39260,39280,39300,39320,39340,39360,39380,39400,39420,39440,39460,39480,39500,39520,39540,39560,39580,39600,39620,39640,39660,39680,39700,39720,39740,39760,39780,39800,39820,39840,39860,39880,39900,39920,39940,39960,39980,40000,40020,40040,40060,40080,40100,40120,40140,40160,40180,40200,40220,40240,40260,40280,40300,40320,40340,40360,40380,40400,40420,40440,40460,40480,40500,40520,40540,40560,40580,40600,40620,40640,40660,40680,40700,40720,40740,40760,40780,40800,40820,40840,40860,40880,40900,40920,40940,40960,40980,41000,41020,41040,41060,41080,41100,41120,41140,41160,41180,41200,41220,41240,41260,41280,41300,41320,41340,41360,41380,41400,41420,41440,41460,41480,41500,41520,41540,41560,41580,41600,41620,41640,41660,41680,41700,41720,41740,41760,41780,41800,41820,41840,41860,41880,41900,41920,41940,41960,41980,42000,42020,42040,42060,42080,42100,42120,42140,42160,42180,42200,42220,42240,42260,42280,42300,42320,42340,42360,42380,42400,42420,42440,42460,42480,42500,42520,42540,42560,42580,42600,42620,42640,42660,42680,42700,42720,42740,42760,42780,42800,42820,42840,42860,42880,42900,42920,42940,42960,42980,43000,43020,43040,43060,43080,43100,43120,43140,43160,43180,43200,43220,43240,43260,43280,43300,43320,43340,43360,43380,43400,43420,43440,43460,43480,43500,43520,43540,43560,43580,43600,43620,43640,43660,43680,43700,43720,43740,43760,43780,43800,43820,43840,43860,43880,43900,43920,43940,43960,43980,44000,44020,44040,44060,44080,44100,44120,44140,44160,44180,44200,44220,44240,44260,44280,44300,44320,44340,44360,44380,44400,44420,44440,44460,44480,44500,44520,44540,44560,44580,44600,44620,44640,44660,44680,44700,44720,44740,44760,44780,44800,44820,44840,44860,44880,44900,44920,44940,44960,44980,45000,45020,45040,45060,45080,45100,45120,45140,45160,45180,45200,45220,45240,45260,45280,45300,45320,45340,45360,45380,45400,45420,45440,45460,45480,45500,45520,45540,45560,45580,45600,45620,45640,45660,45680,45700,45720,45740,45760,45780,45800,45820,45840,45860,45880,45900,45920,45940,45960,45980,46000,46020,46040,46060,46080,46100,46120,46140,46160,46180,46200,46220,46240,46260,46280,46300,46320,46340,46360,46380,46400,46420,46440,46460,46480,46500,46520,46540,46560,46580,46600,46620,46640,46660,46680,46700,46720,46740,46760,46780,46800,46820,46840,46860,46880,46900,46920,46940,46960,46980,47000,47020,47040,47060,47080,47100,47120,47140,47160,47180,47200,47220,47240,47260,47280,47300,47320,47340,47360,47380,47400,47420,47440,47460,47480,47500,47520,47540,47560,47580,47600,47620,47640,47660,47680,47700,47720,47740,47760,47780,47800,47820,47840,47860,47880,47900,47920,47940,47960,47980,48000,48020,48040,48060,48080,48100,48120,48140,48160,48180,48200,48220,48240,48260,48280,48300,48320,48340,48360,48380,48400,48420,48440,48460,48480,48500,48520,48540,48560,48580,48600,48620,48640,48660,48680,48700,48720,48740,48760,48780,48800,48820,48840,48860,48880,48900,48920,48940,48960,48980,49000,49020,49040,49060,49080,49100,49120,49140,49160,49180,49200,49220,49240,49260,49280,49300,49320,49340,49360,49380,49400,49420,49440,49460,49480,49500,49520,49540,49560,49580,49600,49620,49640,49660,49680,49700,49720,49740,49760,49780,49800,49820,49840,49860,49880,49900,49920,49940,49960,49980,50000,50020,50040,50060,50080,50100,50120,50140,50160,50180,50200,50220,50240,50260,50280,50300,50320,50340,50360,50380,50400,50420,50440,50460,50480,50500,50520,50540,50560,50580,50600,50620,50640,50660,50680,50700,50720,50740,50760,50780,50800,50820,50840,50860,50880,50900,50920,50940,50960,50980,51000,51020,51040,51060,51080,51100,51120,51140,51160,51180,51200,51220,51240,51260,51280,51300,51320,51340,51360,51380,51400,51420,51440,51460,51480,51500,51520,51540,51560,51580,51600,51620,51640,51660,51680,51700,51720,51740,51760,51780,51800,51820,51840,51860,51880,51900,51920,51940,51960,51980,52000,52020,52040,52060,52080,52100,52120,52140,52160,52180,52200,52220,52240,52260,52280,52300,52320,52340,52360,52380,52400,52420,52440,52460,52480,52500,52520,52540,52560,52580,52600,52620,52640,52660,52680,52700,52720,52740,52760,52780,52800,52820,52840,52860,52880,52900,52920,52940,52960,52980,53000,53020,53040,53060,53080,53100,53120,53140,53160,53180,53200,53220,53240,53260,53280,53300,53320,53340,53360,53380,53400,53420,53440,53460,53480,53500,53520,53540,53560,53580,53600,53620,53640,53660,53680,53700,53720,53740,53760,53780,53800,53820,53840,53860,53880,53900,53920,53940,53960,53980,54000,54020,54040,54060,54080,54100,54120,54140,54160,54180,54200,54220,54240,54260,54280,54300,54320,54340,54360,54380,54400,54420,54440,54460,54480,54500,54520,54540,54560,54580,54600,54620,54640,54660,54680,54700,54720,54740,54760,54780,54800,54820,54840,54860,54880,54900,54920,54940,54960,54980,55000,55020,55040,55060,55080,55100,55120,55140,55160,55180,55200,55220,55240,55260,55280,55300,55320,55340,55360,55380,55400,55420,55440,55460,55480,55500,55520,55540,55560,55580,55600,55620,55640,55660,55680,55700,55720,55740,55760,55780,55800,55820,55840,55860,55880,55900,55920,55940,55960,55980,56000,56020,56040,56060,56080,56100,56120,56140,56160,56180,56200,56220,56240,56260,56280,56300,56320,56340,56360,56380,56400,56420,56440,56460,56480,56500,56520,56540,56560,56580,56600,56620,56640,56660,56680,56700,56720,56740,56760,56780,56800,56820,56840,56860,56880,56900,56920,56940,56960,56980,57000,57020,57040,57060,57080,57100,57120,57140,57160,57180,57200,57220,57240,57260,57280,57300,57320,57340,57360,57380,57400,57420,57440,57460,57480,57500,57520,57540,57560,57580,57600,57620,57640,57660,57680,57700,57720,57740,57760,57780,57800,57820,57840,57860,57880,57900,57920,57940,57960,57980,58000,58020,58040,58060,58080,58100,58120,58140,58160,58180,58200,58220,58240,58260,58280,58300,58320,58340,58360,58380,58400,58420,58440,58460,58480,58500,58520,58540,58560,58580,58600,58620,58640,58660,58680,58700,58720,58740,58760,58780,58800,58820,58840,58860,58880,58900,58920,58940,58960,58980,59000,59020,59040,59060,59080,59100,59120,59140,59160,59180,59200,59220,59240,59260,59280,59300,59320,59340,59360,59380,59400,59420,59440,59460,59480,59500,59520,59540,59560,59580,59600,59620,59640,59660,59680,59700,59720,59740,59760,59780,59800,59820,59840,59860,59880,59900,59920,59940,59960,59980],"target":[[0,120],[75,100],[175,80],[225,60],[250,40],[1625,340],[1925,1460],[2200,340]]} diff --git a/doc/concept/audio-jitter/reference.ts b/doc/concept/audio-jitter/reference.ts index ecd7a2fd3aa..522751e86be 100644 --- a/doc/concept/audio-jitter/reference.ts +++ b/doc/concept/audio-jitter/reference.ts @@ -75,6 +75,21 @@ export class Estimator { #peak = 0; /** A declared end precedes the next measured observation, so the silence before it is not idle. */ #ended = false; + /** The earliest a frame stalled in this interval was due. */ + #due = Number.POSITIVE_INFINITY; + /** The latest a frame stalled in this interval arrived. */ + #late = Number.NEGATIVE_INFINITY; + + /** The bucket of the open stall's largest delay, folded once the stall ends. */ + #stall?: number; + /** When the open stall's latest stalled frame arrived. */ + #stallLate = 0; + /** The earliest the open stall's frames were due. */ + #stallDue = 0; + /** Intervals the open stall spanned besides the one it folds as. */ + #span = 0; + /** Empty intervals before this one, held until it shows whether they belong to a stall. */ + #pending = 0; #histogram = prior(); /** How much of the histogram is still the prior's rather than evidence. */ @@ -117,6 +132,7 @@ export class Estimator { if (this.#origin === undefined) { this.#origin = arrival; this.#peak = delay; + this.#note(arrival, delay); return; } @@ -125,24 +141,76 @@ export class Estimator { this.#ended = false; if (interval <= this.#interval) { this.#peak = Math.max(this.#peak, delay); + this.#note(arrival, delay); return; } - this.#fold(Math.min(BUCKETS - 1, Math.floor(this.#peak / BUCKET))); + this.#close(Math.min(BUCKETS - 1, Math.floor(this.#peak / BUCKET))); if (resumed) { // The publisher declared the silence, so it is not evidence of anything: the // estimate keeps what it had and a fresh interval starts at this arrival. + this.#settle(); this.#origin = arrival; this.#interval = 0; } else { - const idle = Math.min(interval - this.#interval - 1, IDLE_MAX); - for (let i = 0; i < idle; i++) { - this.#fold(undefined); - } + // Held until this interval closes: a stall it holds owns them. + this.#pending = interval - this.#interval - 1; this.#interval = interval; } this.#peak = delay; + this.#due = Number.POSITIVE_INFINITY; + this.#late = Number.NEGATIVE_INFINITY; + this.#note(arrival, delay); + } + + // A frame later than a whole interval was due in an earlier one, so it is stalled. + #note(arrival: number, delay: number): void { + if (delay > RESAMPLE) { + this.#due = Math.min(this.#due, arrival - delay); + this.#late = Math.max(this.#late, arrival); + } + } + + // An interval whose stalled frames were due before the open stall's last one arrived is + // still behind that stall, so it joins it rather than counting again, for up to a + // window of due time: back-to-back flushes are a recurring stall, not one. + #close(bucket: number): void { + const stalled = this.#late !== Number.NEGATIVE_INFINITY; + const pending = this.#pending; + this.#pending = 0; + if ( + stalled && + this.#stall !== undefined && + this.#due < this.#stallLate && + this.#due - this.#stallDue < WINDOW + ) { + this.#stall = Math.max(this.#stall, bucket); + this.#span += pending + 1; + this.#stallLate = this.#late; + return; + } + + this.#settle(); + if (stalled) { + this.#stall = bucket; + this.#span = pending; + this.#stallLate = this.#late; + this.#stallDue = this.#due; + } else { + for (let i = 0; i < Math.min(pending, IDLE_MAX); i++) this.#fold(undefined); + this.#fold(bucket); + } + } + + // A stall is one observation, its largest delay, and every other interval it spanned is idle. + #settle(): void { + if (this.#stall === undefined) return; + this.#fold(this.#stall); + for (let i = 0; i < Math.min(this.#span, IDLE_MAX); i++) { + this.#fold(undefined); + } + this.#stall = undefined; } /** A declared end lies between the previous observation and the next. */ diff --git a/doc/concept/audio-jitter/silence.json b/doc/concept/audio-jitter/silence.json index 60df4c38167..56d8431992a 100644 --- a/doc/concept/audio-jitter/silence.json +++ b/doc/concept/audio-jitter/silence.json @@ -1 +1 @@ -{"name":"silence","about":"Even audio, a declared end and 60 s of silence, 5 s more, a declared 100 ms pause inside one interval, 5 s more, then an undeclared 30 s gap. Unlike `idle`, a declared silence is not evidence, so the target holds through both; the undeclared gap still relaxes it, since an end covers only the silence it declares.","frame":20,"arrival":[50,70,90,110,130,150,170,190,210,230,250,270,290,310,330,350,370,390,410,430,450,470,490,510,530,550,570,590,610,630,650,670,690,710,730,750,770,790,810,830,850,870,890,910,930,950,970,990,1010,1030,1050,1070,1090,1110,1130,1150,1170,1190,1210,1230,1250,1270,1290,1310,1330,1350,1370,1390,1410,1430,1450,1470,1490,1510,1530,1550,1570,1590,1610,1630,1650,1670,1690,1710,1730,1750,1770,1790,1810,1830,1850,1870,1890,1910,1930,1950,1970,1990,2010,2030,2050,2070,2090,2110,2130,2150,2170,2190,2210,2230,2250,2270,2290,2310,2330,2350,2370,2390,2410,2430,2450,2470,2490,2510,2530,2550,2570,2590,2610,2630,2650,2670,2690,2710,2730,2750,2770,2790,2810,2830,2850,2870,2890,2910,2930,2950,2970,2990,3010,3030,3050,3070,3090,3110,3130,3150,3170,3190,3210,3230,3250,3270,3290,3310,3330,3350,3370,3390,3410,3430,3450,3470,3490,3510,3530,3550,3570,3590,3610,3630,3650,3670,3690,3710,3730,3750,3770,3790,3810,3830,3850,3870,3890,3910,3930,3950,3970,3990,4010,4030,4050,4070,4090,4110,4130,4150,4170,4190,4210,4230,4250,4270,4290,4310,4330,4350,4370,4390,4410,4430,4450,4470,4490,4510,4530,4550,4570,4590,4610,4630,4650,4670,4690,4710,4730,4750,4770,4790,4810,4830,4850,4870,4890,4910,4930,4950,4970,4990,5010,5030,5050,5070,5090,5110,5130,5150,5170,5190,5210,5230,5250,5270,5290,5310,5330,5350,5370,5390,5410,5430,5450,5470,5490,5510,5530,5550,5570,5590,5610,5630,5650,5670,5690,5710,5730,5750,5770,5790,5810,5830,5850,5870,5890,5910,5930,5950,5970,5990,6010,6030,6050,6070,6090,6110,6130,6150,6170,6190,6210,6230,6250,6270,6290,6310,6330,6350,6370,6390,6410,6430,6450,6470,6490,6510,6530,6550,6570,6590,6610,6630,6650,6670,6690,6710,6730,6750,6770,6790,6810,6830,6850,6870,6890,6910,6930,6950,6970,6990,7010,7030,7050,7070,7090,7110,7130,7150,7170,7190,7210,7230,7250,7270,7290,7310,7330,7350,7370,7390,7410,7430,7450,7470,7490,7510,7530,7550,7570,7590,7610,7630,7650,7670,7690,7710,7730,7750,7770,7790,7810,7830,7850,7870,7890,7910,7930,7950,7970,7990,8010,8030,8050,8070,8090,8110,8130,8150,8170,8190,8210,8230,8250,8270,8290,8310,8330,8350,8370,8390,8410,8430,8450,8470,8490,8510,8530,8550,8570,8590,8610,8630,8650,8670,8690,8710,8730,8750,8770,8790,8810,8830,8850,8870,8890,8910,8930,8950,8970,8990,9010,9030,9050,9070,9090,9110,9130,9150,9170,9190,9210,9230,9250,9270,9290,9310,9330,9350,9370,9390,9410,9430,9450,9470,9490,9510,9530,9550,9570,9590,9610,9630,9650,9670,9690,9710,9730,9750,9770,9790,9810,9830,9850,9870,9890,9910,9930,9950,9970,9990,10010,10030,70050,70070,70090,70110,70130,70150,70170,70190,70210,70230,70250,70270,70290,70310,70330,70350,70370,70390,70410,70430,70450,70470,70490,70510,70530,70550,70570,70590,70610,70630,70650,70670,70690,70710,70730,70750,70770,70790,70810,70830,70850,70870,70890,70910,70930,70950,70970,70990,71010,71030,71050,71070,71090,71110,71130,71150,71170,71190,71210,71230,71250,71270,71290,71310,71330,71350,71370,71390,71410,71430,71450,71470,71490,71510,71530,71550,71570,71590,71610,71630,71650,71670,71690,71710,71730,71750,71770,71790,71810,71830,71850,71870,71890,71910,71930,71950,71970,71990,72010,72030,72050,72070,72090,72110,72130,72150,72170,72190,72210,72230,72250,72270,72290,72310,72330,72350,72370,72390,72410,72430,72450,72470,72490,72510,72530,72550,72570,72590,72610,72630,72650,72670,72690,72710,72730,72750,72770,72790,72810,72830,72850,72870,72890,72910,72930,72950,72970,72990,73010,73030,73050,73070,73090,73110,73130,73150,73170,73190,73210,73230,73250,73270,73290,73310,73330,73350,73370,73390,73410,73430,73450,73470,73490,73510,73530,73550,73570,73590,73610,73630,73650,73670,73690,73710,73730,73750,73770,73790,73810,73830,73850,73870,73890,73910,73930,73950,73970,73990,74010,74030,74050,74070,74090,74110,74130,74150,74170,74190,74210,74230,74250,74270,74290,74310,74330,74350,74370,74390,74410,74430,74450,74470,74490,74510,74530,74550,74570,74590,74610,74630,74650,74670,74690,74710,74730,74750,74770,74790,74810,74830,74850,74870,74890,74910,74930,74950,74970,74990,75010,75030,75050,75070,75090,75110,75130,75150,75170,75190,75210,75230,75350,75370,75390,75410,75430,75450,75470,75490,75510,75530,75550,75570,75590,75610,75630,75650,75670,75690,75710,75730,75750,75770,75790,75810,75830,75850,75870,75890,75910,75930,75950,75970,75990,76010,76030,76050,76070,76090,76110,76130,76150,76170,76190,76210,76230,76250,76270,76290,76310,76330,76350,76370,76390,76410,76430,76450,76470,76490,76510,76530,76550,76570,76590,76610,76630,76650,76670,76690,76710,76730,76750,76770,76790,76810,76830,76850,76870,76890,76910,76930,76950,76970,76990,77010,77030,77050,77070,77090,77110,77130,77150,77170,77190,77210,77230,77250,77270,77290,77310,77330,77350,77370,77390,77410,77430,77450,77470,77490,77510,77530,77550,77570,77590,77610,77630,77650,77670,77690,77710,77730,77750,77770,77790,77810,77830,77850,77870,77890,77910,77930,77950,77970,77990,78010,78030,78050,78070,78090,78110,78130,78150,78170,78190,78210,78230,78250,78270,78290,78310,78330,78350,78370,78390,78410,78430,78450,78470,78490,78510,78530,78550,78570,78590,78610,78630,78650,78670,78690,78710,78730,78750,78770,78790,78810,78830,78850,78870,78890,78910,78930,78950,78970,78990,79010,79030,79050,79070,79090,79110,79130,79150,79170,79190,79210,79230,79250,79270,79290,79310,79330,79350,79370,79390,79410,79430,79450,79470,79490,79510,79530,79550,79570,79590,79610,79630,79650,79670,79690,79710,79730,79750,79770,79790,79810,79830,79850,79870,79890,79910,79930,79950,79970,79990,80010,80030,80050,80070,80090,80110,80130,110150,110170,110190,110210,110230,110250,110270,110290,110310,110330,110350,110370,110390,110410,110430,110450,110470,110490,110510,110530,110550,110570,110590,110610,110630,110650,110670,110690,110710,110730,110750,110770,110790,110810,110830,110850,110870,110890,110910,110930,110950,110970,110990,111010,111030,111050,111070,111090,111110,111130,111150,111170,111190,111210,111230,111250,111270,111290,111310,111330,111350,111370,111390,111410,111430,111450,111470,111490,111510,111530,111550,111570,111590,111610,111630,111650,111670,111690,111710,111730,111750,111770,111790,111810,111830,111850,111870,111890,111910,111930,111950,111970,111990,112010,112030,112050,112070,112090,112110,112130,112150,112170,112190,112210,112230,112250,112270,112290,112310,112330,112350,112370,112390,112410,112430,112450,112470,112490,112510,112530,112550,112570,112590,112610,112630,112650,112670,112690,112710,112730,112750,112770,112790,112810,112830,112850,112870,112890,112910,112930,112950,112970,112990,113010,113030,113050,113070,113090,113110,113130,113150,113170,113190,113210,113230,113250,113270,113290,113310,113330,113350,113370,113390,113410,113430,113450,113470,113490,113510,113530,113550,113570,113590,113610,113630,113650,113670,113690,113710,113730,113750,113770,113790,113810,113830,113850,113870,113890,113910,113930,113950,113970,113990,114010,114030,114050,114070,114090,114110,114130,114150,114170,114190,114210,114230,114250,114270,114290,114310,114330,114350,114370,114390,114410,114430,114450,114470,114490,114510,114530,114550,114570,114590,114610,114630,114650,114670,114690,114710,114730,114750,114770,114790,114810,114830,114850,114870,114890,114910,114930,114950,114970,114990,115010,115030,115050,115070,115090,115110,115130,115150,115170,115190,115210,115230,115250,115270,115290,115310,115330,115350,115370,115390,115410,115430,115450,115470,115490,115510,115530,115550,115570,115590,115610,115630,115650,115670,115690,115710,115730,115750,115770,115790,115810,115830,115850,115870,115890,115910,115930,115950,115970,115990,116010,116030,116050,116070,116090,116110,116130,116150,116170,116190,116210,116230,116250,116270,116290,116310,116330,116350,116370,116390,116410,116430,116450,116470,116490,116510,116530,116550,116570,116590,116610,116630,116650,116670,116690,116710,116730,116750,116770,116790,116810,116830,116850,116870,116890,116910,116930,116950,116970,116990,117010,117030,117050,117070,117090,117110,117130,117150,117170,117190,117210,117230,117250,117270,117290,117310,117330,117350,117370,117390,117410,117430,117450,117470,117490,117510,117530,117550,117570,117590,117610,117630,117650,117670,117690,117710,117730,117750,117770,117790,117810,117830,117850,117870,117890,117910,117930,117950,117970,117990,118010,118030,118050,118070,118090,118110,118130,118150,118170,118190,118210,118230,118250,118270,118290,118310,118330,118350,118370,118390,118410,118430,118450,118470,118490,118510,118530,118550,118570,118590,118610,118630,118650,118670,118690,118710,118730,118750,118770,118790,118810,118830,118850,118870,118890,118910,118930,118950,118970,118990,119010,119030,119050,119070,119090,119110,119130,119150,119170,119190,119210,119230,119250,119270,119290,119310,119330,119350,119370,119390,119410,119430,119450,119470,119490,119510,119530,119550,119570,119590,119610,119630,119650,119670,119690,119710,119730,119750,119770,119790,119810,119830,119850,119870,119890,119910,119930,119950,119970,119990,120010,120030,120050,120070,120090,120110,120130],"media":[0,20,40,60,80,100,120,140,160,180,200,220,240,260,280,300,320,340,360,380,400,420,440,460,480,500,520,540,560,580,600,620,640,660,680,700,720,740,760,780,800,820,840,860,880,900,920,940,960,980,1000,1020,1040,1060,1080,1100,1120,1140,1160,1180,1200,1220,1240,1260,1280,1300,1320,1340,1360,1380,1400,1420,1440,1460,1480,1500,1520,1540,1560,1580,1600,1620,1640,1660,1680,1700,1720,1740,1760,1780,1800,1820,1840,1860,1880,1900,1920,1940,1960,1980,2000,2020,2040,2060,2080,2100,2120,2140,2160,2180,2200,2220,2240,2260,2280,2300,2320,2340,2360,2380,2400,2420,2440,2460,2480,2500,2520,2540,2560,2580,2600,2620,2640,2660,2680,2700,2720,2740,2760,2780,2800,2820,2840,2860,2880,2900,2920,2940,2960,2980,3000,3020,3040,3060,3080,3100,3120,3140,3160,3180,3200,3220,3240,3260,3280,3300,3320,3340,3360,3380,3400,3420,3440,3460,3480,3500,3520,3540,3560,3580,3600,3620,3640,3660,3680,3700,3720,3740,3760,3780,3800,3820,3840,3860,3880,3900,3920,3940,3960,3980,4000,4020,4040,4060,4080,4100,4120,4140,4160,4180,4200,4220,4240,4260,4280,4300,4320,4340,4360,4380,4400,4420,4440,4460,4480,4500,4520,4540,4560,4580,4600,4620,4640,4660,4680,4700,4720,4740,4760,4780,4800,4820,4840,4860,4880,4900,4920,4940,4960,4980,5000,5020,5040,5060,5080,5100,5120,5140,5160,5180,5200,5220,5240,5260,5280,5300,5320,5340,5360,5380,5400,5420,5440,5460,5480,5500,5520,5540,5560,5580,5600,5620,5640,5660,5680,5700,5720,5740,5760,5780,5800,5820,5840,5860,5880,5900,5920,5940,5960,5980,6000,6020,6040,6060,6080,6100,6120,6140,6160,6180,6200,6220,6240,6260,6280,6300,6320,6340,6360,6380,6400,6420,6440,6460,6480,6500,6520,6540,6560,6580,6600,6620,6640,6660,6680,6700,6720,6740,6760,6780,6800,6820,6840,6860,6880,6900,6920,6940,6960,6980,7000,7020,7040,7060,7080,7100,7120,7140,7160,7180,7200,7220,7240,7260,7280,7300,7320,7340,7360,7380,7400,7420,7440,7460,7480,7500,7520,7540,7560,7580,7600,7620,7640,7660,7680,7700,7720,7740,7760,7780,7800,7820,7840,7860,7880,7900,7920,7940,7960,7980,8000,8020,8040,8060,8080,8100,8120,8140,8160,8180,8200,8220,8240,8260,8280,8300,8320,8340,8360,8380,8400,8420,8440,8460,8480,8500,8520,8540,8560,8580,8600,8620,8640,8660,8680,8700,8720,8740,8760,8780,8800,8820,8840,8860,8880,8900,8920,8940,8960,8980,9000,9020,9040,9060,9080,9100,9120,9140,9160,9180,9200,9220,9240,9260,9280,9300,9320,9340,9360,9380,9400,9420,9440,9460,9480,9500,9520,9540,9560,9580,9600,9620,9640,9660,9680,9700,9720,9740,9760,9780,9800,9820,9840,9860,9880,9900,9920,9940,9960,9980,70000,70020,70040,70060,70080,70100,70120,70140,70160,70180,70200,70220,70240,70260,70280,70300,70320,70340,70360,70380,70400,70420,70440,70460,70480,70500,70520,70540,70560,70580,70600,70620,70640,70660,70680,70700,70720,70740,70760,70780,70800,70820,70840,70860,70880,70900,70920,70940,70960,70980,71000,71020,71040,71060,71080,71100,71120,71140,71160,71180,71200,71220,71240,71260,71280,71300,71320,71340,71360,71380,71400,71420,71440,71460,71480,71500,71520,71540,71560,71580,71600,71620,71640,71660,71680,71700,71720,71740,71760,71780,71800,71820,71840,71860,71880,71900,71920,71940,71960,71980,72000,72020,72040,72060,72080,72100,72120,72140,72160,72180,72200,72220,72240,72260,72280,72300,72320,72340,72360,72380,72400,72420,72440,72460,72480,72500,72520,72540,72560,72580,72600,72620,72640,72660,72680,72700,72720,72740,72760,72780,72800,72820,72840,72860,72880,72900,72920,72940,72960,72980,73000,73020,73040,73060,73080,73100,73120,73140,73160,73180,73200,73220,73240,73260,73280,73300,73320,73340,73360,73380,73400,73420,73440,73460,73480,73500,73520,73540,73560,73580,73600,73620,73640,73660,73680,73700,73720,73740,73760,73780,73800,73820,73840,73860,73880,73900,73920,73940,73960,73980,74000,74020,74040,74060,74080,74100,74120,74140,74160,74180,74200,74220,74240,74260,74280,74300,74320,74340,74360,74380,74400,74420,74440,74460,74480,74500,74520,74540,74560,74580,74600,74620,74640,74660,74680,74700,74720,74740,74760,74780,74800,74820,74840,74860,74880,74900,74920,74940,74960,74980,75000,75020,75040,75060,75080,75100,75120,75140,75160,75180,75300,75320,75340,75360,75380,75400,75420,75440,75460,75480,75500,75520,75540,75560,75580,75600,75620,75640,75660,75680,75700,75720,75740,75760,75780,75800,75820,75840,75860,75880,75900,75920,75940,75960,75980,76000,76020,76040,76060,76080,76100,76120,76140,76160,76180,76200,76220,76240,76260,76280,76300,76320,76340,76360,76380,76400,76420,76440,76460,76480,76500,76520,76540,76560,76580,76600,76620,76640,76660,76680,76700,76720,76740,76760,76780,76800,76820,76840,76860,76880,76900,76920,76940,76960,76980,77000,77020,77040,77060,77080,77100,77120,77140,77160,77180,77200,77220,77240,77260,77280,77300,77320,77340,77360,77380,77400,77420,77440,77460,77480,77500,77520,77540,77560,77580,77600,77620,77640,77660,77680,77700,77720,77740,77760,77780,77800,77820,77840,77860,77880,77900,77920,77940,77960,77980,78000,78020,78040,78060,78080,78100,78120,78140,78160,78180,78200,78220,78240,78260,78280,78300,78320,78340,78360,78380,78400,78420,78440,78460,78480,78500,78520,78540,78560,78580,78600,78620,78640,78660,78680,78700,78720,78740,78760,78780,78800,78820,78840,78860,78880,78900,78920,78940,78960,78980,79000,79020,79040,79060,79080,79100,79120,79140,79160,79180,79200,79220,79240,79260,79280,79300,79320,79340,79360,79380,79400,79420,79440,79460,79480,79500,79520,79540,79560,79580,79600,79620,79640,79660,79680,79700,79720,79740,79760,79780,79800,79820,79840,79860,79880,79900,79920,79940,79960,79980,80000,80020,80040,80060,80080,110100,110120,110140,110160,110180,110200,110220,110240,110260,110280,110300,110320,110340,110360,110380,110400,110420,110440,110460,110480,110500,110520,110540,110560,110580,110600,110620,110640,110660,110680,110700,110720,110740,110760,110780,110800,110820,110840,110860,110880,110900,110920,110940,110960,110980,111000,111020,111040,111060,111080,111100,111120,111140,111160,111180,111200,111220,111240,111260,111280,111300,111320,111340,111360,111380,111400,111420,111440,111460,111480,111500,111520,111540,111560,111580,111600,111620,111640,111660,111680,111700,111720,111740,111760,111780,111800,111820,111840,111860,111880,111900,111920,111940,111960,111980,112000,112020,112040,112060,112080,112100,112120,112140,112160,112180,112200,112220,112240,112260,112280,112300,112320,112340,112360,112380,112400,112420,112440,112460,112480,112500,112520,112540,112560,112580,112600,112620,112640,112660,112680,112700,112720,112740,112760,112780,112800,112820,112840,112860,112880,112900,112920,112940,112960,112980,113000,113020,113040,113060,113080,113100,113120,113140,113160,113180,113200,113220,113240,113260,113280,113300,113320,113340,113360,113380,113400,113420,113440,113460,113480,113500,113520,113540,113560,113580,113600,113620,113640,113660,113680,113700,113720,113740,113760,113780,113800,113820,113840,113860,113880,113900,113920,113940,113960,113980,114000,114020,114040,114060,114080,114100,114120,114140,114160,114180,114200,114220,114240,114260,114280,114300,114320,114340,114360,114380,114400,114420,114440,114460,114480,114500,114520,114540,114560,114580,114600,114620,114640,114660,114680,114700,114720,114740,114760,114780,114800,114820,114840,114860,114880,114900,114920,114940,114960,114980,115000,115020,115040,115060,115080,115100,115120,115140,115160,115180,115200,115220,115240,115260,115280,115300,115320,115340,115360,115380,115400,115420,115440,115460,115480,115500,115520,115540,115560,115580,115600,115620,115640,115660,115680,115700,115720,115740,115760,115780,115800,115820,115840,115860,115880,115900,115920,115940,115960,115980,116000,116020,116040,116060,116080,116100,116120,116140,116160,116180,116200,116220,116240,116260,116280,116300,116320,116340,116360,116380,116400,116420,116440,116460,116480,116500,116520,116540,116560,116580,116600,116620,116640,116660,116680,116700,116720,116740,116760,116780,116800,116820,116840,116860,116880,116900,116920,116940,116960,116980,117000,117020,117040,117060,117080,117100,117120,117140,117160,117180,117200,117220,117240,117260,117280,117300,117320,117340,117360,117380,117400,117420,117440,117460,117480,117500,117520,117540,117560,117580,117600,117620,117640,117660,117680,117700,117720,117740,117760,117780,117800,117820,117840,117860,117880,117900,117920,117940,117960,117980,118000,118020,118040,118060,118080,118100,118120,118140,118160,118180,118200,118220,118240,118260,118280,118300,118320,118340,118360,118380,118400,118420,118440,118460,118480,118500,118520,118540,118560,118580,118600,118620,118640,118660,118680,118700,118720,118740,118760,118780,118800,118820,118840,118860,118880,118900,118920,118940,118960,118980,119000,119020,119040,119060,119080,119100,119120,119140,119160,119180,119200,119220,119240,119260,119280,119300,119320,119340,119360,119380,119400,119420,119440,119460,119480,119500,119520,119540,119560,119580,119600,119620,119640,119660,119680,119700,119720,119740,119760,119780,119800,119820,119840,119860,119880,119900,119920,119940,119960,119980,120000,120020,120040,120060,120080],"ends":[500,760],"target":[[0,120],[75,100],[175,80],[225,60],[250,40],[1000,100],[1070,80],[1120,60],[1145,40]]} +{"name":"silence","about":"Even audio, a declared end and 60 s of silence, 5 s more, a declared 100 ms pause inside one interval, 5 s more, then an undeclared 30 s gap. Unlike `idle`, a declared silence is not evidence, so the target holds through both; the undeclared gap still relaxes it, since an end covers only the silence it declares.","frame":20,"arrival":[50,70,90,110,130,150,170,190,210,230,250,270,290,310,330,350,370,390,410,430,450,470,490,510,530,550,570,590,610,630,650,670,690,710,730,750,770,790,810,830,850,870,890,910,930,950,970,990,1010,1030,1050,1070,1090,1110,1130,1150,1170,1190,1210,1230,1250,1270,1290,1310,1330,1350,1370,1390,1410,1430,1450,1470,1490,1510,1530,1550,1570,1590,1610,1630,1650,1670,1690,1710,1730,1750,1770,1790,1810,1830,1850,1870,1890,1910,1930,1950,1970,1990,2010,2030,2050,2070,2090,2110,2130,2150,2170,2190,2210,2230,2250,2270,2290,2310,2330,2350,2370,2390,2410,2430,2450,2470,2490,2510,2530,2550,2570,2590,2610,2630,2650,2670,2690,2710,2730,2750,2770,2790,2810,2830,2850,2870,2890,2910,2930,2950,2970,2990,3010,3030,3050,3070,3090,3110,3130,3150,3170,3190,3210,3230,3250,3270,3290,3310,3330,3350,3370,3390,3410,3430,3450,3470,3490,3510,3530,3550,3570,3590,3610,3630,3650,3670,3690,3710,3730,3750,3770,3790,3810,3830,3850,3870,3890,3910,3930,3950,3970,3990,4010,4030,4050,4070,4090,4110,4130,4150,4170,4190,4210,4230,4250,4270,4290,4310,4330,4350,4370,4390,4410,4430,4450,4470,4490,4510,4530,4550,4570,4590,4610,4630,4650,4670,4690,4710,4730,4750,4770,4790,4810,4830,4850,4870,4890,4910,4930,4950,4970,4990,5010,5030,5050,5070,5090,5110,5130,5150,5170,5190,5210,5230,5250,5270,5290,5310,5330,5350,5370,5390,5410,5430,5450,5470,5490,5510,5530,5550,5570,5590,5610,5630,5650,5670,5690,5710,5730,5750,5770,5790,5810,5830,5850,5870,5890,5910,5930,5950,5970,5990,6010,6030,6050,6070,6090,6110,6130,6150,6170,6190,6210,6230,6250,6270,6290,6310,6330,6350,6370,6390,6410,6430,6450,6470,6490,6510,6530,6550,6570,6590,6610,6630,6650,6670,6690,6710,6730,6750,6770,6790,6810,6830,6850,6870,6890,6910,6930,6950,6970,6990,7010,7030,7050,7070,7090,7110,7130,7150,7170,7190,7210,7230,7250,7270,7290,7310,7330,7350,7370,7390,7410,7430,7450,7470,7490,7510,7530,7550,7570,7590,7610,7630,7650,7670,7690,7710,7730,7750,7770,7790,7810,7830,7850,7870,7890,7910,7930,7950,7970,7990,8010,8030,8050,8070,8090,8110,8130,8150,8170,8190,8210,8230,8250,8270,8290,8310,8330,8350,8370,8390,8410,8430,8450,8470,8490,8510,8530,8550,8570,8590,8610,8630,8650,8670,8690,8710,8730,8750,8770,8790,8810,8830,8850,8870,8890,8910,8930,8950,8970,8990,9010,9030,9050,9070,9090,9110,9130,9150,9170,9190,9210,9230,9250,9270,9290,9310,9330,9350,9370,9390,9410,9430,9450,9470,9490,9510,9530,9550,9570,9590,9610,9630,9650,9670,9690,9710,9730,9750,9770,9790,9810,9830,9850,9870,9890,9910,9930,9950,9970,9990,10010,10030,70050,70070,70090,70110,70130,70150,70170,70190,70210,70230,70250,70270,70290,70310,70330,70350,70370,70390,70410,70430,70450,70470,70490,70510,70530,70550,70570,70590,70610,70630,70650,70670,70690,70710,70730,70750,70770,70790,70810,70830,70850,70870,70890,70910,70930,70950,70970,70990,71010,71030,71050,71070,71090,71110,71130,71150,71170,71190,71210,71230,71250,71270,71290,71310,71330,71350,71370,71390,71410,71430,71450,71470,71490,71510,71530,71550,71570,71590,71610,71630,71650,71670,71690,71710,71730,71750,71770,71790,71810,71830,71850,71870,71890,71910,71930,71950,71970,71990,72010,72030,72050,72070,72090,72110,72130,72150,72170,72190,72210,72230,72250,72270,72290,72310,72330,72350,72370,72390,72410,72430,72450,72470,72490,72510,72530,72550,72570,72590,72610,72630,72650,72670,72690,72710,72730,72750,72770,72790,72810,72830,72850,72870,72890,72910,72930,72950,72970,72990,73010,73030,73050,73070,73090,73110,73130,73150,73170,73190,73210,73230,73250,73270,73290,73310,73330,73350,73370,73390,73410,73430,73450,73470,73490,73510,73530,73550,73570,73590,73610,73630,73650,73670,73690,73710,73730,73750,73770,73790,73810,73830,73850,73870,73890,73910,73930,73950,73970,73990,74010,74030,74050,74070,74090,74110,74130,74150,74170,74190,74210,74230,74250,74270,74290,74310,74330,74350,74370,74390,74410,74430,74450,74470,74490,74510,74530,74550,74570,74590,74610,74630,74650,74670,74690,74710,74730,74750,74770,74790,74810,74830,74850,74870,74890,74910,74930,74950,74970,74990,75010,75030,75050,75070,75090,75110,75130,75150,75170,75190,75210,75230,75350,75370,75390,75410,75430,75450,75470,75490,75510,75530,75550,75570,75590,75610,75630,75650,75670,75690,75710,75730,75750,75770,75790,75810,75830,75850,75870,75890,75910,75930,75950,75970,75990,76010,76030,76050,76070,76090,76110,76130,76150,76170,76190,76210,76230,76250,76270,76290,76310,76330,76350,76370,76390,76410,76430,76450,76470,76490,76510,76530,76550,76570,76590,76610,76630,76650,76670,76690,76710,76730,76750,76770,76790,76810,76830,76850,76870,76890,76910,76930,76950,76970,76990,77010,77030,77050,77070,77090,77110,77130,77150,77170,77190,77210,77230,77250,77270,77290,77310,77330,77350,77370,77390,77410,77430,77450,77470,77490,77510,77530,77550,77570,77590,77610,77630,77650,77670,77690,77710,77730,77750,77770,77790,77810,77830,77850,77870,77890,77910,77930,77950,77970,77990,78010,78030,78050,78070,78090,78110,78130,78150,78170,78190,78210,78230,78250,78270,78290,78310,78330,78350,78370,78390,78410,78430,78450,78470,78490,78510,78530,78550,78570,78590,78610,78630,78650,78670,78690,78710,78730,78750,78770,78790,78810,78830,78850,78870,78890,78910,78930,78950,78970,78990,79010,79030,79050,79070,79090,79110,79130,79150,79170,79190,79210,79230,79250,79270,79290,79310,79330,79350,79370,79390,79410,79430,79450,79470,79490,79510,79530,79550,79570,79590,79610,79630,79650,79670,79690,79710,79730,79750,79770,79790,79810,79830,79850,79870,79890,79910,79930,79950,79970,79990,80010,80030,80050,80070,80090,80110,80130,110150,110170,110190,110210,110230,110250,110270,110290,110310,110330,110350,110370,110390,110410,110430,110450,110470,110490,110510,110530,110550,110570,110590,110610,110630,110650,110670,110690,110710,110730,110750,110770,110790,110810,110830,110850,110870,110890,110910,110930,110950,110970,110990,111010,111030,111050,111070,111090,111110,111130,111150,111170,111190,111210,111230,111250,111270,111290,111310,111330,111350,111370,111390,111410,111430,111450,111470,111490,111510,111530,111550,111570,111590,111610,111630,111650,111670,111690,111710,111730,111750,111770,111790,111810,111830,111850,111870,111890,111910,111930,111950,111970,111990,112010,112030,112050,112070,112090,112110,112130,112150,112170,112190,112210,112230,112250,112270,112290,112310,112330,112350,112370,112390,112410,112430,112450,112470,112490,112510,112530,112550,112570,112590,112610,112630,112650,112670,112690,112710,112730,112750,112770,112790,112810,112830,112850,112870,112890,112910,112930,112950,112970,112990,113010,113030,113050,113070,113090,113110,113130,113150,113170,113190,113210,113230,113250,113270,113290,113310,113330,113350,113370,113390,113410,113430,113450,113470,113490,113510,113530,113550,113570,113590,113610,113630,113650,113670,113690,113710,113730,113750,113770,113790,113810,113830,113850,113870,113890,113910,113930,113950,113970,113990,114010,114030,114050,114070,114090,114110,114130,114150,114170,114190,114210,114230,114250,114270,114290,114310,114330,114350,114370,114390,114410,114430,114450,114470,114490,114510,114530,114550,114570,114590,114610,114630,114650,114670,114690,114710,114730,114750,114770,114790,114810,114830,114850,114870,114890,114910,114930,114950,114970,114990,115010,115030,115050,115070,115090,115110,115130,115150,115170,115190,115210,115230,115250,115270,115290,115310,115330,115350,115370,115390,115410,115430,115450,115470,115490,115510,115530,115550,115570,115590,115610,115630,115650,115670,115690,115710,115730,115750,115770,115790,115810,115830,115850,115870,115890,115910,115930,115950,115970,115990,116010,116030,116050,116070,116090,116110,116130,116150,116170,116190,116210,116230,116250,116270,116290,116310,116330,116350,116370,116390,116410,116430,116450,116470,116490,116510,116530,116550,116570,116590,116610,116630,116650,116670,116690,116710,116730,116750,116770,116790,116810,116830,116850,116870,116890,116910,116930,116950,116970,116990,117010,117030,117050,117070,117090,117110,117130,117150,117170,117190,117210,117230,117250,117270,117290,117310,117330,117350,117370,117390,117410,117430,117450,117470,117490,117510,117530,117550,117570,117590,117610,117630,117650,117670,117690,117710,117730,117750,117770,117790,117810,117830,117850,117870,117890,117910,117930,117950,117970,117990,118010,118030,118050,118070,118090,118110,118130,118150,118170,118190,118210,118230,118250,118270,118290,118310,118330,118350,118370,118390,118410,118430,118450,118470,118490,118510,118530,118550,118570,118590,118610,118630,118650,118670,118690,118710,118730,118750,118770,118790,118810,118830,118850,118870,118890,118910,118930,118950,118970,118990,119010,119030,119050,119070,119090,119110,119130,119150,119170,119190,119210,119230,119250,119270,119290,119310,119330,119350,119370,119390,119410,119430,119450,119470,119490,119510,119530,119550,119570,119590,119610,119630,119650,119670,119690,119710,119730,119750,119770,119790,119810,119830,119850,119870,119890,119910,119930,119950,119970,119990,120010,120030,120050,120070,120090,120110,120130],"media":[0,20,40,60,80,100,120,140,160,180,200,220,240,260,280,300,320,340,360,380,400,420,440,460,480,500,520,540,560,580,600,620,640,660,680,700,720,740,760,780,800,820,840,860,880,900,920,940,960,980,1000,1020,1040,1060,1080,1100,1120,1140,1160,1180,1200,1220,1240,1260,1280,1300,1320,1340,1360,1380,1400,1420,1440,1460,1480,1500,1520,1540,1560,1580,1600,1620,1640,1660,1680,1700,1720,1740,1760,1780,1800,1820,1840,1860,1880,1900,1920,1940,1960,1980,2000,2020,2040,2060,2080,2100,2120,2140,2160,2180,2200,2220,2240,2260,2280,2300,2320,2340,2360,2380,2400,2420,2440,2460,2480,2500,2520,2540,2560,2580,2600,2620,2640,2660,2680,2700,2720,2740,2760,2780,2800,2820,2840,2860,2880,2900,2920,2940,2960,2980,3000,3020,3040,3060,3080,3100,3120,3140,3160,3180,3200,3220,3240,3260,3280,3300,3320,3340,3360,3380,3400,3420,3440,3460,3480,3500,3520,3540,3560,3580,3600,3620,3640,3660,3680,3700,3720,3740,3760,3780,3800,3820,3840,3860,3880,3900,3920,3940,3960,3980,4000,4020,4040,4060,4080,4100,4120,4140,4160,4180,4200,4220,4240,4260,4280,4300,4320,4340,4360,4380,4400,4420,4440,4460,4480,4500,4520,4540,4560,4580,4600,4620,4640,4660,4680,4700,4720,4740,4760,4780,4800,4820,4840,4860,4880,4900,4920,4940,4960,4980,5000,5020,5040,5060,5080,5100,5120,5140,5160,5180,5200,5220,5240,5260,5280,5300,5320,5340,5360,5380,5400,5420,5440,5460,5480,5500,5520,5540,5560,5580,5600,5620,5640,5660,5680,5700,5720,5740,5760,5780,5800,5820,5840,5860,5880,5900,5920,5940,5960,5980,6000,6020,6040,6060,6080,6100,6120,6140,6160,6180,6200,6220,6240,6260,6280,6300,6320,6340,6360,6380,6400,6420,6440,6460,6480,6500,6520,6540,6560,6580,6600,6620,6640,6660,6680,6700,6720,6740,6760,6780,6800,6820,6840,6860,6880,6900,6920,6940,6960,6980,7000,7020,7040,7060,7080,7100,7120,7140,7160,7180,7200,7220,7240,7260,7280,7300,7320,7340,7360,7380,7400,7420,7440,7460,7480,7500,7520,7540,7560,7580,7600,7620,7640,7660,7680,7700,7720,7740,7760,7780,7800,7820,7840,7860,7880,7900,7920,7940,7960,7980,8000,8020,8040,8060,8080,8100,8120,8140,8160,8180,8200,8220,8240,8260,8280,8300,8320,8340,8360,8380,8400,8420,8440,8460,8480,8500,8520,8540,8560,8580,8600,8620,8640,8660,8680,8700,8720,8740,8760,8780,8800,8820,8840,8860,8880,8900,8920,8940,8960,8980,9000,9020,9040,9060,9080,9100,9120,9140,9160,9180,9200,9220,9240,9260,9280,9300,9320,9340,9360,9380,9400,9420,9440,9460,9480,9500,9520,9540,9560,9580,9600,9620,9640,9660,9680,9700,9720,9740,9760,9780,9800,9820,9840,9860,9880,9900,9920,9940,9960,9980,70000,70020,70040,70060,70080,70100,70120,70140,70160,70180,70200,70220,70240,70260,70280,70300,70320,70340,70360,70380,70400,70420,70440,70460,70480,70500,70520,70540,70560,70580,70600,70620,70640,70660,70680,70700,70720,70740,70760,70780,70800,70820,70840,70860,70880,70900,70920,70940,70960,70980,71000,71020,71040,71060,71080,71100,71120,71140,71160,71180,71200,71220,71240,71260,71280,71300,71320,71340,71360,71380,71400,71420,71440,71460,71480,71500,71520,71540,71560,71580,71600,71620,71640,71660,71680,71700,71720,71740,71760,71780,71800,71820,71840,71860,71880,71900,71920,71940,71960,71980,72000,72020,72040,72060,72080,72100,72120,72140,72160,72180,72200,72220,72240,72260,72280,72300,72320,72340,72360,72380,72400,72420,72440,72460,72480,72500,72520,72540,72560,72580,72600,72620,72640,72660,72680,72700,72720,72740,72760,72780,72800,72820,72840,72860,72880,72900,72920,72940,72960,72980,73000,73020,73040,73060,73080,73100,73120,73140,73160,73180,73200,73220,73240,73260,73280,73300,73320,73340,73360,73380,73400,73420,73440,73460,73480,73500,73520,73540,73560,73580,73600,73620,73640,73660,73680,73700,73720,73740,73760,73780,73800,73820,73840,73860,73880,73900,73920,73940,73960,73980,74000,74020,74040,74060,74080,74100,74120,74140,74160,74180,74200,74220,74240,74260,74280,74300,74320,74340,74360,74380,74400,74420,74440,74460,74480,74500,74520,74540,74560,74580,74600,74620,74640,74660,74680,74700,74720,74740,74760,74780,74800,74820,74840,74860,74880,74900,74920,74940,74960,74980,75000,75020,75040,75060,75080,75100,75120,75140,75160,75180,75300,75320,75340,75360,75380,75400,75420,75440,75460,75480,75500,75520,75540,75560,75580,75600,75620,75640,75660,75680,75700,75720,75740,75760,75780,75800,75820,75840,75860,75880,75900,75920,75940,75960,75980,76000,76020,76040,76060,76080,76100,76120,76140,76160,76180,76200,76220,76240,76260,76280,76300,76320,76340,76360,76380,76400,76420,76440,76460,76480,76500,76520,76540,76560,76580,76600,76620,76640,76660,76680,76700,76720,76740,76760,76780,76800,76820,76840,76860,76880,76900,76920,76940,76960,76980,77000,77020,77040,77060,77080,77100,77120,77140,77160,77180,77200,77220,77240,77260,77280,77300,77320,77340,77360,77380,77400,77420,77440,77460,77480,77500,77520,77540,77560,77580,77600,77620,77640,77660,77680,77700,77720,77740,77760,77780,77800,77820,77840,77860,77880,77900,77920,77940,77960,77980,78000,78020,78040,78060,78080,78100,78120,78140,78160,78180,78200,78220,78240,78260,78280,78300,78320,78340,78360,78380,78400,78420,78440,78460,78480,78500,78520,78540,78560,78580,78600,78620,78640,78660,78680,78700,78720,78740,78760,78780,78800,78820,78840,78860,78880,78900,78920,78940,78960,78980,79000,79020,79040,79060,79080,79100,79120,79140,79160,79180,79200,79220,79240,79260,79280,79300,79320,79340,79360,79380,79400,79420,79440,79460,79480,79500,79520,79540,79560,79580,79600,79620,79640,79660,79680,79700,79720,79740,79760,79780,79800,79820,79840,79860,79880,79900,79920,79940,79960,79980,80000,80020,80040,80060,80080,110100,110120,110140,110160,110180,110200,110220,110240,110260,110280,110300,110320,110340,110360,110380,110400,110420,110440,110460,110480,110500,110520,110540,110560,110580,110600,110620,110640,110660,110680,110700,110720,110740,110760,110780,110800,110820,110840,110860,110880,110900,110920,110940,110960,110980,111000,111020,111040,111060,111080,111100,111120,111140,111160,111180,111200,111220,111240,111260,111280,111300,111320,111340,111360,111380,111400,111420,111440,111460,111480,111500,111520,111540,111560,111580,111600,111620,111640,111660,111680,111700,111720,111740,111760,111780,111800,111820,111840,111860,111880,111900,111920,111940,111960,111980,112000,112020,112040,112060,112080,112100,112120,112140,112160,112180,112200,112220,112240,112260,112280,112300,112320,112340,112360,112380,112400,112420,112440,112460,112480,112500,112520,112540,112560,112580,112600,112620,112640,112660,112680,112700,112720,112740,112760,112780,112800,112820,112840,112860,112880,112900,112920,112940,112960,112980,113000,113020,113040,113060,113080,113100,113120,113140,113160,113180,113200,113220,113240,113260,113280,113300,113320,113340,113360,113380,113400,113420,113440,113460,113480,113500,113520,113540,113560,113580,113600,113620,113640,113660,113680,113700,113720,113740,113760,113780,113800,113820,113840,113860,113880,113900,113920,113940,113960,113980,114000,114020,114040,114060,114080,114100,114120,114140,114160,114180,114200,114220,114240,114260,114280,114300,114320,114340,114360,114380,114400,114420,114440,114460,114480,114500,114520,114540,114560,114580,114600,114620,114640,114660,114680,114700,114720,114740,114760,114780,114800,114820,114840,114860,114880,114900,114920,114940,114960,114980,115000,115020,115040,115060,115080,115100,115120,115140,115160,115180,115200,115220,115240,115260,115280,115300,115320,115340,115360,115380,115400,115420,115440,115460,115480,115500,115520,115540,115560,115580,115600,115620,115640,115660,115680,115700,115720,115740,115760,115780,115800,115820,115840,115860,115880,115900,115920,115940,115960,115980,116000,116020,116040,116060,116080,116100,116120,116140,116160,116180,116200,116220,116240,116260,116280,116300,116320,116340,116360,116380,116400,116420,116440,116460,116480,116500,116520,116540,116560,116580,116600,116620,116640,116660,116680,116700,116720,116740,116760,116780,116800,116820,116840,116860,116880,116900,116920,116940,116960,116980,117000,117020,117040,117060,117080,117100,117120,117140,117160,117180,117200,117220,117240,117260,117280,117300,117320,117340,117360,117380,117400,117420,117440,117460,117480,117500,117520,117540,117560,117580,117600,117620,117640,117660,117680,117700,117720,117740,117760,117780,117800,117820,117840,117860,117880,117900,117920,117940,117960,117980,118000,118020,118040,118060,118080,118100,118120,118140,118160,118180,118200,118220,118240,118260,118280,118300,118320,118340,118360,118380,118400,118420,118440,118460,118480,118500,118520,118540,118560,118580,118600,118620,118640,118660,118680,118700,118720,118740,118760,118780,118800,118820,118840,118860,118880,118900,118920,118940,118960,118980,119000,119020,119040,119060,119080,119100,119120,119140,119160,119180,119200,119220,119240,119260,119280,119300,119320,119340,119360,119380,119400,119420,119440,119460,119480,119500,119520,119540,119560,119580,119600,119620,119640,119660,119680,119700,119720,119740,119760,119780,119800,119820,119840,119860,119880,119900,119920,119940,119960,119980,120000,120020,120040,120060,120080],"ends":[500,760],"target":[[0,120],[75,100],[175,80],[225,60],[250,40],[1020,100],[1070,80],[1120,60],[1145,40]]} diff --git a/js/hang/src/container/jitter.test.ts b/js/hang/src/container/jitter.test.ts index 4f7d32d2cf5..4334f6216eb 100644 --- a/js/hang/src/container/jitter.test.ts +++ b/js/hang/src/container/jitter.test.ts @@ -35,10 +35,12 @@ describe("audio jitter conformance", () => { expect(cases.map((c) => c.name).sort()).toEqual([ "advertised", "backlog", + "batches", "buildup", "fixed", "flush", "idle", + "outage", "paced", "reorder", "silence", @@ -94,7 +96,9 @@ describe("Jitter", () => { jitter.end(); for (let i = 0; i < 500; i++) jitter.observe(50 + i * 20, i * 20); const settled = jitter.measured; + // The gap folds once the interval after it closes. jitter.observe(50 + 500 * 20 + 30_000, 500 * 20 + 30_000); + jitter.observe(50 + 500 * 20 + 30_500, 500 * 20 + 30_500); expect(jitter.measured).toBeGreaterThan(settled); }); @@ -127,6 +131,30 @@ describe("Jitter", () => { expect(fork.measured).toBeLessThanOrEqual(learned); expect(warm.measured).toBe(learned); }); + + it("forks an outage still open as its one observation", () => { + // A second of steady arrivals, then 3 s of media flushed in two halves, the second still behind + // the first: one stall, open in the interval in progress when the switch forks. + const feed = (jitter: Jitter) => { + for (let i = 0; i < 50; i++) jitter.observe(i * 20 + 50, i * 20); + for (let i = 50; i < 125; i++) jitter.observe(4_050, i * 20); + for (let i = 125; i < 200; i++) jitter.observe(4_600, i * 20); + }; + const warm = new Jitter(); + feed(warm); + const learned = warm.measured; + expect(learned).toBe(100); + + // The 3 s delay folds once, as when a declared end settles the same stall. + const fork = warm.fork(); + const ended = new Jitter(); + feed(ended); + ended.end(); + ended.observe(5_050, 5_000); + expect(fork.measured).toBe(2000); + expect(fork.measured).toBe(ended.measured); + expect(warm.measured).toBe(learned); + }); }); // The documented scan: the first entry with the smallest key at or before `media`. diff --git a/js/hang/src/container/jitter.ts b/js/hang/src/container/jitter.ts index 2074a4adfd5..2e0f2b57b6e 100644 --- a/js/hang/src/container/jitter.ts +++ b/js/hang/src/container/jitter.ts @@ -39,6 +39,11 @@ const MAX_HISTORY = 8192; /** The cold-start distribution, which is also what an idle interval relaxes back to. */ const PRIOR = Float64Array.from({ length: BUCKETS }, (_, i) => 0.5 ** (i + 1)); +// The histogram bucket a delay in milliseconds lands in, the last holding everything past it. +function bucket(delay: number): number { + return Math.min(BUCKETS - 1, Math.floor(delay / BUCKET)); +} + /** * How much buffer late arrivals need, measured from arrival timing alone. * @@ -61,6 +66,21 @@ export class Jitter { #peak = 0; /** A declared end precedes the next measured observation, so the silence before it is not idle. */ #ended = false; + /** The earliest a frame stalled in this interval was due. */ + #due = Number.POSITIVE_INFINITY; + /** The latest a frame stalled in this interval arrived. */ + #late = Number.NEGATIVE_INFINITY; + + /** The bucket of the open stall's largest delay, folded once the stall ends. */ + #stall?: number; + /** When the open stall's latest stalled frame arrived. */ + #stallLate = 0; + /** The earliest the open stall's frames were due. */ + #stallDue = 0; + /** Intervals the open stall spanned besides the one it folds as. */ + #span = 0; + /** Empty intervals before this one, held until it shows whether they belong to a stall. */ + #pending = 0; #histogram = Float64Array.from(PRIOR); /** How much of the histogram is still the prior's rather than evidence. */ @@ -89,6 +109,7 @@ export class Jitter { if (this.#origin === undefined) { this.#origin = arrival; this.#peak = delay; + this.#note(arrival, delay); return; } @@ -97,23 +118,76 @@ export class Jitter { this.#ended = false; if (interval <= this.#interval) { this.#peak = Math.max(this.#peak, delay); + this.#note(arrival, delay); return; } - this.#fold(Math.min(BUCKETS - 1, Math.floor(this.#peak / BUCKET))); + this.#close(bucket(this.#peak)); if (resumed) { // A silence the publisher declared says nothing about the path, so the estimate keeps // what it had and a fresh interval starts here. + this.#settle(); this.#origin = arrival; this.#interval = 0; } else { - // An interval with no arrival relaxes the estimate toward the prior at the same rate. - const idle = Math.min(interval - this.#interval - 1, IDLE_MAX); - for (let i = 0; i < idle; i++) this.#fold(undefined); + // Held until this interval closes: a stall it holds owns them. + this.#pending = interval - this.#interval - 1; this.#interval = interval; } this.#peak = delay; + this.#due = Number.POSITIVE_INFINITY; + this.#late = Number.NEGATIVE_INFINITY; + this.#note(arrival, delay); + } + + // A frame later than a whole interval was due in an earlier one, so it is stalled. + #note(arrival: number, delay: number): void { + if (delay > RESAMPLE) { + this.#due = Math.min(this.#due, arrival - delay); + this.#late = Math.max(this.#late, arrival); + } + } + + // An interval whose stalled frames were due before the open stall's last one arrived is still + // behind that stall, so it joins it instead of counting again: one outage is one observation, + // as one queue's hundred frames are within an interval. Only for a window of due time, since + // back-to-back flushes are a recurring stall, not one. + #close(bucket: number): void { + const stalled = this.#late !== Number.NEGATIVE_INFINITY; + const pending = this.#pending; + this.#pending = 0; + if ( + stalled && + this.#stall !== undefined && + this.#due < this.#stallLate && + this.#due - this.#stallDue < WINDOW + ) { + this.#stall = Math.max(this.#stall, bucket); + this.#span += pending + 1; + this.#stallLate = this.#late; + return; + } + + this.#settle(); + if (stalled) { + this.#stall = bucket; + this.#span = pending; + this.#stallLate = this.#late; + this.#stallDue = this.#due; + } else { + for (let i = 0; i < Math.min(pending, IDLE_MAX); i++) this.#fold(undefined); + this.#fold(bucket); + } + } + + // A stall folds once, its largest delay, and every other interval it spanned is idle, so the + // estimate keeps its time constant without the stall taking the prior's regained weight. + #settle(): void { + if (this.#stall === undefined) return; + this.#fold(this.#stall); + for (let i = 0; i < Math.min(this.#span, IDLE_MAX); i++) this.#fold(undefined); + this.#stall = undefined; } /** @@ -135,6 +209,22 @@ export class Jitter { const fork = new Jitter(); fork.#histogram = Float64Array.from(this.#histogram); fork.#prior = this.#prior; + // What this one gathered but has not folded, the interval in progress and an open stall, + // folds as if that interval closed here: a switch right after an outage is the likeliest, + // and would otherwise lose the outage's one observation. This one is left as it was. + if (this.#origin !== undefined) { + fork.#stall = this.#stall; + fork.#span = this.#span; + fork.#stallLate = this.#stallLate; + fork.#stallDue = this.#stallDue; + fork.#pending = this.#pending; + fork.#due = this.#due; + fork.#late = this.#late; + fork.#close(bucket(this.#peak)); + fork.#settle(); + fork.#due = Number.POSITIVE_INFINITY; + fork.#late = Number.NEGATIVE_INFINITY; + } return fork; } diff --git a/quest/m2/audio-playout/README.md b/quest/m2/audio-playout/README.md index c65a7104a84..bbbac6c1bcf 100644 --- a/quest/m2/audio-playout/README.md +++ b/quest/m2/audio-playout/README.md @@ -69,7 +69,12 @@ Decisions, with the prompts as asked: about to run out, never trailing past the threshold (rejected: lag only, an underrun being silence). - Target fall: ✅ the implementer measures and picks (rejected: a shorter - half-life now; one observation per outage now). + half-life now; one observation per outage now). Picked 2026-11-13 by + replaying three Nightlies' arrivals: one outage, the intervals its frames + more than one interval late span and the empty ones before them, folds as + one observation (`doc/concept/audio-jitter.md`, "One observation per + stall"). A shorter half-life or a faster-decaying tail cost underruns on + `wide` and `bursty` for less of the fall. - Setting: ✅ `stretch` stays a duration and is the threshold, zero turning the stretch off; it sizes nothing else (rejected: an on/off switch; removing it). @@ -91,8 +96,8 @@ Order: the 200 ms snap both ways is on `main` on today's splices (the congestion catch-up), the [lag rule](/quest/m2/audio-playout/lag-rule.md) replaces the controller under it, and the [clock step](/quest/m2/audio-playout/clock-step.md) builds -on the lag rule. [Target fall](/quest/m2/audio-playout/target-fall.md) and -[output latency](/quest/m2/audio-playout/output-latency.md) are independent. +on the lag rule. [Output latency](/quest/m2/audio-playout/output-latency.md) +and the [join's hold](/quest/m2/audio-playout/join-hold.md) are independent. The [calibration](/quest/m3/audio-calibrate.md) re-measures every ceiling after this epic. diff --git a/quest/m2/audio-playout/join-hold.md b/quest/m2/audio-playout/join-hold.md new file mode 100644 index 00000000000..cde117e409e --- /dev/null +++ b/quest/m2/audio-playout/join-hold.md @@ -0,0 +1,33 @@ +# [M] The join's backlog does not hold the target for 20 s + +## Goal + +A subscription's opening backlog no longer holds the playout target, and +video's delay with it, above the steady state for up to a 20 s half-life +after the join, in both estimators, held by a corpus case. + +## Plan + +Found by the [target fall](https://github.com/moq-dev/moq/pull/8677) +prototype on the 11-11 to 11-13 Nightly captures: the relay delivers the +opening backlog newest first, interleaved with the live edge, and the +estimator measures each backlog frame against the older backlog frames +before it, at 250 to 330 ms. The first one or two intervals fold that at +the cold start's `FRESH_MAX`, 10% each, so the target sits at 320 to 360 ms +for about 20 s on every congestion row, and its residue near the 5% line +lets the next late interval tip it back up. The player never waits for +those frames: a join skips the backlog onto the clock. + +Candidates, to judge by the Nightly rows as the target fall was: + +- Measure a reordered frame against the whole window's fastest frame when + that frame is far ahead of the frame's own reference, so backlog behind + the clock reads as skipped rather than late. +- Do not let an observation above the current target take `FRESH_MAX`; the + prototype found this costs `wide` underruns during the cold start. +- Start measuring at the first frame the player plays. + +Recommended: the first, which keeps the cold start's quick convergence. + +Decided 2026-11-13 (maintainer, `/quest-complete`): ✅ keep this follow-up +(rejected: drop it and accept the 20 s hold after every join). diff --git a/quest/m2/audio-playout/target-fall.md b/quest/m2/audio-playout/target-fall.md deleted file mode 100644 index 297ddd7b08b..00000000000 --- a/quest/m2/audio-playout/target-fall.md +++ /dev/null @@ -1,36 +0,0 @@ -# [M] The target falls back soon after a one-off spike - -## Goal - -After a one-off arrival spike, such as the audio-quality `congestion` row's -1.5 s outage, the playout target, and with it video's delay, returns to its -level before the spike sooner than today's 10 to 23 s, without more underruns -on the `wide`, `bursty`, and `step` rows. One rule in -`doc/concept/audio-jitter.md`, held by its corpus, in both estimators. - -## Plan - -Decided 2026-11-13 (maintainer, /quest-plan): ✅ the implementer prototypes -and picks by the Nightly rows (rejected: a shorter half-life overall now; -counting an outage as one observation now). This reopens the 2026-11-09 -decision that the estimator stays as it is; the -[epic](/quest/m2/audio-playout/README.md) records the rest. - -Why it holds: each 500 ms interval of the outage folds its own peak, so three -or four folds put about 7% of the weight past the 5% the 0.95 quantile -needs, and the 20 s half-life takes 10 to 23 s to decay it. The 11-13 Opus -row's target fell 1020, 720, 340, then 140 ms, holding the whole broadcast -seconds behind live after the link had recovered. - -Candidates: - -- Count one outage, the empty intervals and the burst that ends them, as one - observation. -- Decay the weight above the current target faster than the rest. -- A shorter half-life overall, which re-stalls more on periodic bursts. - -Judge each by how long the congestion row's target stays raised and by -underruns on the other rows, in both players, and add corpus cases for the -pick. A fall is lag like any other under the -[lag rule](/quest/m2/audio-playout/lag-rule.md), so a fall past the -threshold costs one snap rather than a slow catch-up. diff --git a/rs/moq-audio/src/jitter.rs b/rs/moq-audio/src/jitter.rs index 0aa2fda433b..fd7be8b4a32 100644 --- a/rs/moq-audio/src/jitter.rs +++ b/rs/moq-audio/src/jitter.rs @@ -249,6 +249,18 @@ impl History { } } +/// Frames stuck behind one outage across several intervals, folded as one observation. +struct Stall { + /// The bucket of the largest delay seen. + bucket: usize, + /// When the latest stalled frame arrived. + late: f64, + /// The earliest a stalled frame was due. + due: f64, + /// Intervals spanned besides the one it folds as. + span: f64, +} + /// Estimates the playout target from arrival timing alone. pub(crate) struct Estimator { /// The codec's frame duration, never learned from observed timestamps. @@ -269,6 +281,15 @@ pub(crate) struct Estimator { peak: f64, /// A declared end precedes the next measured observation, so the silence before it is not idle. ended: bool, + /// The earliest a frame stalled in this interval was due. + due: f64, + /// The latest a frame stalled in this interval arrived. + late: f64, + + /// The stall still open, folded once it ends. + stall: Option, + /// Empty intervals before this one, held until it shows whether they belong to a stall. + pending: f64, histogram: [f64; BUCKETS], /// How much of the histogram is still the prior's rather than evidence. @@ -286,6 +307,10 @@ impl Estimator { interval: 0.0, peak: 0.0, ended: false, + due: f64::INFINITY, + late: f64::NEG_INFINITY, + stall: None, + pending: 0.0, histogram: std::array::from_fn(prior), prior: 1.0, } @@ -315,6 +340,7 @@ impl Estimator { let Some(origin) = self.origin else { self.origin = Some(arrival); self.peak = delay; + self.note(arrival, delay); return; }; @@ -322,25 +348,83 @@ impl Estimator { let resumed = std::mem::take(&mut self.ended); if interval <= self.interval { self.peak = self.peak.max(delay); + self.note(arrival, delay); return; } - self.fold(Some(((self.peak / BUCKET).floor() as usize).min(BUCKETS - 1))); + self.close(((self.peak / BUCKET).floor() as usize).min(BUCKETS - 1)); if resumed { // A silence the publisher declared says nothing about the path, so the // estimate keeps what it had and a fresh interval starts here. + self.settle(); self.origin = Some(arrival); self.interval = 0.0; } else { - // An interval with no arrival relaxes the estimate toward the prior. - let idle = f64::min(interval - self.interval - 1.0, IDLE_MAX); - for _ in 0..idle as u32 { - self.fold(None); - } + // Held until this interval closes: a stall it holds owns them. + self.pending = interval - self.interval - 1.0; self.interval = interval; } self.peak = delay; + self.due = f64::INFINITY; + self.late = f64::NEG_INFINITY; + self.note(arrival, delay); + } + + /// A frame later than a whole interval was due in an earlier one, so it is stalled. + fn note(&mut self, arrival: f64, delay: f64) { + if delay > RESAMPLE { + self.due = self.due.min(arrival - delay); + self.late = self.late.max(arrival); + } + } + + /// Folds the interval that just ended. One whose stalled frames were due before the + /// open stall's last one arrived is still behind that stall, so it joins it instead + /// of counting again: one outage is one observation, as one queue's hundred frames + /// are within an interval. Only for a window of due time, since back-to-back + /// flushes are a recurring stall, not one. + fn close(&mut self, bucket: usize) { + let stalled = self.late != f64::NEG_INFINITY; + let pending = std::mem::take(&mut self.pending); + if stalled + && let Some(stall) = &mut self.stall + && self.due < stall.late + && self.due - stall.due < WINDOW + { + stall.bucket = stall.bucket.max(bucket); + stall.span += pending + 1.0; + stall.late = self.late; + return; + } + + self.settle(); + if stalled { + self.stall = Some(Stall { + bucket, + late: self.late, + due: self.due, + span: pending, + }); + } else { + for _ in 0..f64::min(pending, IDLE_MAX) as u32 { + self.fold(None); + } + self.fold(Some(bucket)); + } + } + + /// A stall folds once, its largest delay, and every other interval it spanned is + /// idle, so the estimate keeps its time constant without the stall taking the + /// prior's regained weight. + fn settle(&mut self) { + let Some(stall) = self.stall.take() else { + return; + }; + self.fold(Some(stall.bucket)); + for _ in 0..f64::min(stall.span, IDLE_MAX) as u32 { + self.fold(None); + } } /// A declared end lies between the previous observation and the next, so the @@ -446,13 +530,15 @@ pub(crate) mod tests { /// Every case the document lists. Named rather than globbed, so a case that /// goes missing fails here instead of silently shrinking the suite. - const CORPUS: [&str; 12] = [ + const CORPUS: [&str; 14] = [ "advertised", "backlog", + "batches", "buildup", "fixed", "flush", "idle", + "outage", "paced", "reorder", "silence", @@ -512,7 +598,9 @@ pub(crate) mod tests { target.observe(50.0 + i as f64 * 20.0, i as f64 * 20.0); } let settled = target.millis(); + // The gap folds once the interval after it closes. target.observe(50.0 + 500.0 * 20.0 + 30_000.0, 500.0 * 20.0 + 30_000.0); + target.observe(50.0 + 500.0 * 20.0 + 30_500.0, 500.0 * 20.0 + 30_500.0); assert!(target.millis() > settled); } @@ -527,10 +615,12 @@ pub(crate) mod tests { fn the_measured_term_is_bounded_by_the_histogram() { let mut target = Target::new(Duration::ZERO, true, None); target.set_frame(20.0); - // A frame every 20 ms of media arriving a whole second apart: every interval - // sees a delay far past the last bucket. - for i in 0..200 { - target.observe(i as f64 * 1000.0, i as f64 * 20.0); + // A publisher flushing 3 s of media at once, every 3 s: each flush is its own + // stall, with its first frame later than the last bucket. + for batch in 0..200 { + for frame in 0..150 { + target.observe((batch + 1) as f64 * 3000.0, (batch * 3000 + frame * 20) as f64); + } } assert_eq!(target.millis(), BUCKETS as f64 * BUCKET + 20.0); } diff --git a/test/audio-quality/budgets.json b/test/audio-quality/budgets.json index 1b763eda39f..cae63d2ae1f 100644 --- a/test/audio-quality/budgets.json +++ b/test/audio-quality/budgets.json @@ -1,5 +1,5 @@ { - "note": "The browser rows are measured on the nightly runner (ubuntu-24.04-arm, headless Chromium, seed 7, 60 s a row), from the audio-quality-run artifacts of the seven scheduled Nightly runs on main from 2026-10-29 to 2026-11-04 (40885347517, 41065371094, 41204380716, 41313466339, 41483654426, 41656613559, 41852517544), the first after a fresh subscriber stopped receiving the relay's cached history. The six AAC rows other than congestion are measured the same way from the seven runs from 2026-11-05 to 2026-11-11 (42050683248, 42236107954, 42377867523, 42487375545, 42659882487, 42842827718, 43041909115), the first after the TS importer published each PES as one group; the first four predate the browser's time stretch, and the six rows keep the four provisional ceilings set below from 2026-11-09 and 2026-11-10. Each ceiling is the worst of its seven nights times 1.25, plus one runner hiccup, rounded up to two significant figures. The hiccup is sized from the single gaps the 2026-10-08 night put on otherwise clean rows, the fixed-250 control among them: 250 underruns/min, 700 gap ms/min, 3.3 skips/min, 280 dropped ms/min (both sized on the playhead's skip-ahead inference, and now applied to player_skips_per_min and trimmed_ms_per_min), 0.01 stalled, 0.015 silence, and one 20 ms bucket of target. Budgeted this way, every night passes when it is held out of its row's measurement except one, and that row's own ceiling includes it: the 2026-11-03 Opus bursty row raised its target to 300 ms 2.6 s in and held it for one 20 s half-life before settling at 180. Such startup holds, Opus near-zero's 100 ms on 2026-10-30 and 10-31 among them, are budgeted as measured. These ceilings record today's player as the runner hears it, not target audio quality. To re-measure, download the same artifact from the latest scheduled nightlies (`gh run download -n audio-quality-run`), which keep every run, and apply the same rule. On 2026-11-10 the inferred skip_aheads and discarded_ms keys were dropped, since they read a time stretch's catch-up as dropped audio, and every browser row gained player_skips_per_min, trimmed_ms_per_min, and av_lag_ms p50 and p95, by the same rule from the only two scheduled nights on main with today's browser player and its trim counter, 2026-11-09 and 2026-11-10 (42659882487, 42842827718). A lag is signed, so its ceiling is the worst night plus a quarter of its size plus one 20 ms bucket. These four keys are provisional until seven nights with the stretch model re-measure every row. The grade follows the model: audio rests on the shared clock, trails it through a stall, and catches up after. When a change moves a row, a steady-state lag (av_lag_ms p50) that rises, or audio the player trimmed, is a regression to fix rather than budget; a p95 lag that rises through a stall, or an underrun count that moves, is re-measured in. No ceiling is fixed at zero underruns or zero stalls; a replay row's is exactly what it measured. The replay rows are deterministic, so their ceilings are exactly what they measured, through the end of each recording, with no headroom: any regression fails them, and an improvement should be tightened in. They were last re-measured on 2026-10-22 using version 3 traces with encoded frame durations: AAC-LC uses its fixed 1024 samples, and relay-mic retains Opus packet TOC durations. relay-mic was re-recorded on 2026-11-03 from a real microphone, Chrome 156 on a MacBook Air publishing its built-in microphone through the public relay, recorded by headless Chromium on a Linux host (35 s, minimum RTT 2 ms), which raised its target ceiling from 60 to 80 ms and its silence from 0 to 0.001 as measured. The recording path itself has no added RTT. relay-mic-rtt40 is the 2026-11-03 Chrome row at 40 ms of added RTT on that laptop (180 s, minimum RTT 47 ms), kept as the baseline time stretch improves on; like every replay row, its player_underruns_per_min ceiling is what it measures, not a fixed zero. player_underruns_per_min, the player's own counter that its stats panel shows, is budgeted on the replay rows only; it counts the run-dry re-stalls the tap files as stalled time. On 2026-11-07, after the ordered read stopped delivering groups below its cursor (#8071) and took Rust's hole and age bounds (#8218), relay-bbb was re-measured at 16.1 player underruns/min, 0.025 stalled and 0.02 silence, and relay-mic-rtt40 at 8.2, its discarded audio at 70.9 ms/min and its target p95 at 320 ms rather than 780, since the stale backlog it never played no longer reaches the estimator; neither row lost audio the previous player heard. On 2026-11-08 the player began time-stretching live playback with NetEq's accelerate, deciding on the ring's depth right after each arrival and never expanding, and every replay row was re-measured with it, the browser rows left to the nightly runner. Each row's av_lag_ms, how far the playhead trails the shared clock video plays from, is what it measured: the ring rests one frame ahead of the newest arrival's playout, as the trim it replaces left it, so audio leads the clock by 19 to 23 ms at p50. Against the trim, the A/V lag p50 fell from 0.7, -17.5, -21.5, -18.2 and -15.6 ms to -22.4 on bursty-aac, -22.2 on local-aac, -22.7 on relay-bbb, -19 on relay-mic and -20.1 on relay-mic-rtt40, and its p95 fell on every row, most on relay-bbb (10.5 to -4.2) and relay-mic-rtt40 (-0.9 to -13.4). Underruns stayed where the trim had them, as the latency they would cost is not spent: player_underruns_per_min held at 4.4, 12.1, 16.1 and 6.1 and rose from 8.2 to 10.6 on relay-mic-rtt40, and relay-mic's tap now files 2 short quanta a minute, 2 ms of missing audio, where it filed none. What the stretch buys is the audio the trim dropped: discarded_ms_per_min fell from 87.8 to 0 on relay-bbb and from 127.5 to 100.6 on local-aac, whose remainder drops nothing: two receive stalls 14 and 15.3 s in leave audio 159 and 132 ms behind the clock, and the fast accelerate brings it back within half a second. player_skips_per_min and trimmed_ms_per_min, the ring's own count of re-anchors that dropped buffered audio and the media they dropped, are budgeted beside it, at 0 on every recorded row. relay-mic-stall, added 2026-11-10, is relay-mic with nothing arriving from 15 s to 16.5 s and the held frames then trickling in at twice real time until 18 s; today's player trims 2152.5 ms/min of it and its target p95 rises to 1540 ms. Once durations became whole nanoseconds, relay-bbb's delay, 200 ms plus one 1024-sample AAC frame, rounds up by a fraction of a sample, so its ring holds one more sample (23 µs) and its A/V lag p50 measures -22.6 rather than -22.7. Neither replay calibration changed the browser or native ceilings. bursty-aac is the 2026-10-18 AAC bursty isolated capture, recorded with the observer subscribed at the decoder's 2 s budget, so it holds every group the player saw. The native rows are provisional: measured on a loaded developer host (x86_64 Linux, the private PulseAudio null sink, seed 7, 60 s a row) on 2026-10-17, three runs of every row from the debug build nightly uses plus three more of the AAC rows from a release build, which played alike. Each ceiling is the worst clean run times 1.25, plus one native hiccup sized from the unimpaired Opus row's worst run (20 underruns/min, 50 gap ms/min, 2.2 skips/min, 110 discarded ms/min, 0.01 stalled, 0.005 silence, one 20 ms bucket of target), rounded up to two significant figures. On 2026-11-10, after native playback began reporting its A/V lag (#8361), the native rows' player_skips_per_min, trimmed_ms_per_min, and av_lag_ms p50 and p95, and every key of the native and browser congestion rows, were measured by the same rules from three runs of each on a loaded developer host (x86_64 Linux, the debug build, seed 7, 60 s a row), with no void; native audio rests 9 to 95 ms behind its clock at p50. These are provisional until the stretch model's nightly re-measure, which also moves the browser congestion rows onto the runner. On the 2026-10-17 host the null sink's clock ran about 150 ppm slow against the monotonic clock, read within 5 ms at p95 per sample, and its output latency sat between 14 and 28 ms. Five of the 36 AAC rows (none of the 18 Opus rows) voided on the clock: the device stopped pulling for about two seconds mid-row, sometimes after a backend error and a stream restart, which is a native playback defect rather than noise, and the ceilings exclude those runs. Re-measure from the nightly runner's artifacts once it has a week of native rows. On 2026-11-11 every player began following one stretch rule on the shared clock: it slows down below its target, speeds up above it, and skips only past its bound, which in the browser is the subscription's max delay. Every replay row was re-measured with it, the browser and native rows left to the nightly runner. Audio now rests on the clock rather than one frame ahead of it, so the A/V lag p50 rose from about -20 ms to 0.4 ms on relay-bbb, 1.1 on relay-mic, 1.2 on relay-mic-rtt40 and 1.8 on local-aac. Its p95 rose on every row, since audio that falls behind is now caught up by speeding up rather than trimmed: the shared clock steps forward as its reference converges through a tune-in backlog, and again when a target falls, and audio follows at the accelerate's pace, which on the replay's constant tone is one 2.5 ms period a window, slower than on speech. bursty-aac rests 5 ms behind its clock, so its p50 of 10.4 ms is mostly its catch-ups, and relay-mic-stall's p50 of 66.1 ms is the catch-up after its target falls from 1540 to 80 ms, which outlasts half the row. In exchange nothing is trimmed: relay-mic-stall's trimmed_ms_per_min fell from 2152.5 to 0, its skips from 6.1 to 0, and its underruns from 24.2 to 0 a minute, and player_underruns_per_min fell from 12.1 to 4 on local-aac, 16.1 to 0 on relay-bbb, 6.1 to 0 on relay-mic, 10.6 to 2.7 on relay-mic-rtt40 and 6.1 to 4 on relay-mic-stall, holding at 4.4 on bursty-aac. The tap now files 3.3 to 6.1 short quanta a minute on the AAC rows, under 0.3 ms of missing audio, where it filed none. To deliver the audio a stall delays, the container consumer now waits and skips at the subscription's max delay, as native already does, rather than at the delay plus lookahead. relay-mic-rtt40's join backlog arrives reordered, so the consumer now waits on its holes and the estimator observes the frames that fill them, up to 775 ms late, and its target p95 returns from 320 to 780 ms, held for one half-life after the join. Later on 2026-11-11 audio began skipping as far as the shared clock's reference moves earlier, once those moves add up to one stretch window and only as far as it holds audio past its target, rather than speeding through them, and every replay row was re-measured. The tune-in backlog's jumps now land before the graded window, so the A/V lag p95 fell from 453.1 to 2.1 ms on relay-bbb (its p50 from 0.4 to -1.3), 743.7 to 1.9 on relay-mic-rtt40, whose p50 fell from 1.2 to 0.4 and its tap's missing audio rose from 0.6 to 0.9 ms a minute, since a jump past what is decoded skips the rest once it lands,, 335.5 to 39.2 on local-aac and 88.6 to 0.3 on relay-mic, and the p50 from 66.1 to 25.3 on relay-mic-stall, with nothing trimmed in any graded window. The tap's underruns fell from 6.1 to 2 a minute on local-aac and 6.1 to 0 on relay-bbb; local-aac's silence rose from 0.001 to 0.002. Later on 2026-11-11 the container consumer began waiting on a missing group only for the delay plus the lookahead, while still delivering groups that arrived until they age past the max delay, and every replay row was re-measured. relay-mic-rtt40's target p95 fell from 780 back to 320 ms, since the holes in its reordered join backlog no longer delay the frames behind them; its tap's missing audio rose from 0.9 to 1.1 ms a minute and its A/V lag p50 and p95 from 0.4 and 1.9 to 0.7 and 2.4 ms. bursty-aac's silence rose from 0.007 to 0.009 and its A/V lag p95 fell from 162.1 to 156.3 ms, and relay-bbb's lag p50 and p95 moved from -1.3 and 2.1 to -1.2 and 2.2 ms. relay-mic-stall did not move. Also on 2026-11-11 the stretch became a player setting, 2 s by default, and the audio subscription's max delay became the delay plus it rather than the 2 s constant, so the container consumer delivers a late group that much longer before it ages out, and every replay row was re-measured: only relay-mic moved, its A/V lag p50 and p95 from 0.3 to 1.6 ms, under the 2.5 ms pitch period the stretch can move it by. Holding the constant max delay with the new bound reproduces the old values exactly. On 2026-11-12 the replays stopped playing a constant and began playing a seeded speech-like signal (syllables gliding a 90 to 220 Hz fundamental, with pauses held above the silence classifier), since the stretch's pitch search found only its shortest period in a constant, and the browser ring stopped zero-filling a hole of up to a millisecond and two samples between frames, as native stopped writing silence for one: the recorded AAC timestamps land up to 2.5 samples either side of a 1024-sample boundary, and on speech the 2-sample holes this filled ended 119.1 quanta a minute short on bursty-aac. Every replay row was re-measured. The tap's underruns fell to 0 on bursty-aac (from 3.3) and local-aac (from 2), and relay-mic-rtt40's missing audio from 1.1 to 0.3 ms a minute while its player underruns rose from 2.7 to 3.1. The A/V lag p95 fell from 156.3 to 104.8 ms on bursty-aac, 39.2 to 15.1 on local-aac, 2.2 to 1.4 on relay-bbb and 501.8 to 484.9 on relay-mic-stall, whose p50 fell from 25.3 to 1.1, and rose from 1.6 to 3.4 on relay-mic and 2.4 to 3.5 on relay-mic-rtt40. Where audio rests moved within one speech pitch period, which is as close as one stretch seam can steer it: the p50 is 11 ms on bursty-aac (from 10.4), -4.2 on relay-bbb (from -1.2), 1.1 on relay-mic (from 1.6), 0.9 on relay-mic-rtt40 (from 0.7) and 1.7 on local-aac (from 1.8). On 2026-11-13 the stretch default fell from 2 s to 200 ms and audio trailing the clock past it began skipping onto the clock rather than back to the bound, as video skips, with the audio subscription still reaching 2 s past the delay; every replay row was re-measured. A target fall past 200 ms now costs one skip rather than seconds of catch-up, and so does a trail past it, and a rise past it pads silence until the clock arrives rather than slowing down: relay-mic-stall skips the 1.46 s it trails after the outage and its 1540 to 1020 and 1020 to 80 ms falls, and pads the 0.5 s its 60 to 1540 ms rise leaves it ahead, where it slowed down for 4 s, so it trims 4678.2 ms a minute where it trimmed none and its stalled share rose from 0.05 to 0.067 and silence from 0.049 to 0.085. The frames it holds through the outage then trickle in at twice real time, so its low buffer slows it to 154 ms behind the clock, where it had sat ahead of it: its A/V lag p95 fell from 484.9 to 118.6 ms and its p50 rose from 1.1 to 2.2. relay-mic-rtt40 skips its 320 to 80 ms fall, 0.3 skips and 83.3 trimmed ms a minute, its p95 from 3.5 to 2.9 ms. bursty-aac skips a 225 ms trail 6 s in, 1.1 skips and 312.7 trimmed ms a minute, its p95 from 102.7 to 49.2 ms and p50 from 11 to 10. relay-mic trims nothing, but its tune-in's skips land on the clock rather than at the bound, which moves where it rests within a pitch period: its p50 from 1.1 to 2.2 ms and p95 from 3.4 to 4.5. Trimming at a target fall or a trail past 200 ms is the rule, not a regression. Also on 2026-11-13, for the same change, the congestion rows' trimmed_ms_per_min ceilings were raised by the same rule from two runs of each on a loaded developer host (x86_64 Linux, the debug build, seed 7, 60 s a row): to 3800 on chromium AAC (worst 2740.3 ms/min), 3700 on chromium Opus (2697.2), 3900 on native AAC (2996.9) and 4600 on native Opus (3532.3), whose player_skips_per_min rose to 15 (9.8). The trim is the outage's audio skipped onto the clock rather than played seconds late: against main on the same host, chromium's A/V lag p95 fell from 1396.8 to 61.6 ms on AAC and 1424.8 to 64.3 on Opus, and native's from 1246.3 to 116.7 and 826.9 to 117.5. These four ceilings are provisional until the nightly re-measures the congestion rows.", + "note": "The browser rows are measured on the nightly runner (ubuntu-24.04-arm, headless Chromium, seed 7, 60 s a row), from the audio-quality-run artifacts of the seven scheduled Nightly runs on main from 2026-10-29 to 2026-11-04 (40885347517, 41065371094, 41204380716, 41313466339, 41483654426, 41656613559, 41852517544), the first after a fresh subscriber stopped receiving the relay's cached history. The six AAC rows other than congestion are measured the same way from the seven runs from 2026-11-05 to 2026-11-11 (42050683248, 42236107954, 42377867523, 42487375545, 42659882487, 42842827718, 43041909115), the first after the TS importer published each PES as one group; the first four predate the browser's time stretch, and the six rows keep the four provisional ceilings set below from 2026-11-09 and 2026-11-10. Each ceiling is the worst of its seven nights times 1.25, plus one runner hiccup, rounded up to two significant figures. The hiccup is sized from the single gaps the 2026-10-08 night put on otherwise clean rows, the fixed-250 control among them: 250 underruns/min, 700 gap ms/min, 3.3 skips/min, 280 dropped ms/min (both sized on the playhead's skip-ahead inference, and now applied to player_skips_per_min and trimmed_ms_per_min), 0.01 stalled, 0.015 silence, and one 20 ms bucket of target. Budgeted this way, every night passes when it is held out of its row's measurement except one, and that row's own ceiling includes it: the 2026-11-03 Opus bursty row raised its target to 300 ms 2.6 s in and held it for one 20 s half-life before settling at 180. Such startup holds, Opus near-zero's 100 ms on 2026-10-30 and 10-31 among them, are budgeted as measured. These ceilings record today's player as the runner hears it, not target audio quality. To re-measure, download the same artifact from the latest scheduled nightlies (`gh run download -n audio-quality-run`), which keep every run, and apply the same rule. On 2026-11-10 the inferred skip_aheads and discarded_ms keys were dropped, since they read a time stretch's catch-up as dropped audio, and every browser row gained player_skips_per_min, trimmed_ms_per_min, and av_lag_ms p50 and p95, by the same rule from the only two scheduled nights on main with today's browser player and its trim counter, 2026-11-09 and 2026-11-10 (42659882487, 42842827718). A lag is signed, so its ceiling is the worst night plus a quarter of its size plus one 20 ms bucket. These four keys are provisional until seven nights with the stretch model re-measure every row. The grade follows the model: audio rests on the shared clock, trails it through a stall, and catches up after. When a change moves a row, a steady-state lag (av_lag_ms p50) that rises, or audio the player trimmed, is a regression to fix rather than budget; a p95 lag that rises through a stall, or an underrun count that moves, is re-measured in. No ceiling is fixed at zero underruns or zero stalls; a replay row's is exactly what it measured. The replay rows are deterministic, so their ceilings are exactly what they measured, through the end of each recording, with no headroom: any regression fails them, and an improvement should be tightened in. They were last re-measured on 2026-10-22 using version 3 traces with encoded frame durations: AAC-LC uses its fixed 1024 samples, and relay-mic retains Opus packet TOC durations. relay-mic was re-recorded on 2026-11-03 from a real microphone, Chrome 156 on a MacBook Air publishing its built-in microphone through the public relay, recorded by headless Chromium on a Linux host (35 s, minimum RTT 2 ms), which raised its target ceiling from 60 to 80 ms and its silence from 0 to 0.001 as measured. The recording path itself has no added RTT. relay-mic-rtt40 is the 2026-11-03 Chrome row at 40 ms of added RTT on that laptop (180 s, minimum RTT 47 ms), kept as the baseline time stretch improves on; like every replay row, its player_underruns_per_min ceiling is what it measures, not a fixed zero. player_underruns_per_min, the player's own counter that its stats panel shows, is budgeted on the replay rows only; it counts the run-dry re-stalls the tap files as stalled time. On 2026-11-07, after the ordered read stopped delivering groups below its cursor (#8071) and took Rust's hole and age bounds (#8218), relay-bbb was re-measured at 16.1 player underruns/min, 0.025 stalled and 0.02 silence, and relay-mic-rtt40 at 8.2, its discarded audio at 70.9 ms/min and its target p95 at 320 ms rather than 780, since the stale backlog it never played no longer reaches the estimator; neither row lost audio the previous player heard. On 2026-11-08 the player began time-stretching live playback with NetEq's accelerate, deciding on the ring's depth right after each arrival and never expanding, and every replay row was re-measured with it, the browser rows left to the nightly runner. Each row's av_lag_ms, how far the playhead trails the shared clock video plays from, is what it measured: the ring rests one frame ahead of the newest arrival's playout, as the trim it replaces left it, so audio leads the clock by 19 to 23 ms at p50. Against the trim, the A/V lag p50 fell from 0.7, -17.5, -21.5, -18.2 and -15.6 ms to -22.4 on bursty-aac, -22.2 on local-aac, -22.7 on relay-bbb, -19 on relay-mic and -20.1 on relay-mic-rtt40, and its p95 fell on every row, most on relay-bbb (10.5 to -4.2) and relay-mic-rtt40 (-0.9 to -13.4). Underruns stayed where the trim had them, as the latency they would cost is not spent: player_underruns_per_min held at 4.4, 12.1, 16.1 and 6.1 and rose from 8.2 to 10.6 on relay-mic-rtt40, and relay-mic's tap now files 2 short quanta a minute, 2 ms of missing audio, where it filed none. What the stretch buys is the audio the trim dropped: discarded_ms_per_min fell from 87.8 to 0 on relay-bbb and from 127.5 to 100.6 on local-aac, whose remainder drops nothing: two receive stalls 14 and 15.3 s in leave audio 159 and 132 ms behind the clock, and the fast accelerate brings it back within half a second. player_skips_per_min and trimmed_ms_per_min, the ring's own count of re-anchors that dropped buffered audio and the media they dropped, are budgeted beside it, at 0 on every recorded row. relay-mic-stall, added 2026-11-10, is relay-mic with nothing arriving from 15 s to 16.5 s and the held frames then trickling in at twice real time until 18 s; today's player trims 2152.5 ms/min of it and its target p95 rises to 1540 ms. Once durations became whole nanoseconds, relay-bbb's delay, 200 ms plus one 1024-sample AAC frame, rounds up by a fraction of a sample, so its ring holds one more sample (23 µs) and its A/V lag p50 measures -22.6 rather than -22.7. Neither replay calibration changed the browser or native ceilings. bursty-aac is the 2026-10-18 AAC bursty isolated capture, recorded with the observer subscribed at the decoder's 2 s budget, so it holds every group the player saw. The native rows are provisional: measured on a loaded developer host (x86_64 Linux, the private PulseAudio null sink, seed 7, 60 s a row) on 2026-10-17, three runs of every row from the debug build nightly uses plus three more of the AAC rows from a release build, which played alike. Each ceiling is the worst clean run times 1.25, plus one native hiccup sized from the unimpaired Opus row's worst run (20 underruns/min, 50 gap ms/min, 2.2 skips/min, 110 discarded ms/min, 0.01 stalled, 0.005 silence, one 20 ms bucket of target), rounded up to two significant figures. On 2026-11-10, after native playback began reporting its A/V lag (#8361), the native rows' player_skips_per_min, trimmed_ms_per_min, and av_lag_ms p50 and p95, and every key of the native and browser congestion rows, were measured by the same rules from three runs of each on a loaded developer host (x86_64 Linux, the debug build, seed 7, 60 s a row), with no void; native audio rests 9 to 95 ms behind its clock at p50. These are provisional until the stretch model's nightly re-measure, which also moves the browser congestion rows onto the runner. On the 2026-10-17 host the null sink's clock ran about 150 ppm slow against the monotonic clock, read within 5 ms at p95 per sample, and its output latency sat between 14 and 28 ms. Five of the 36 AAC rows (none of the 18 Opus rows) voided on the clock: the device stopped pulling for about two seconds mid-row, sometimes after a backend error and a stream restart, which is a native playback defect rather than noise, and the ceilings exclude those runs. Re-measure from the nightly runner's artifacts once it has a week of native rows. On 2026-11-11 every player began following one stretch rule on the shared clock: it slows down below its target, speeds up above it, and skips only past its bound, which in the browser is the subscription's max delay. Every replay row was re-measured with it, the browser and native rows left to the nightly runner. Audio now rests on the clock rather than one frame ahead of it, so the A/V lag p50 rose from about -20 ms to 0.4 ms on relay-bbb, 1.1 on relay-mic, 1.2 on relay-mic-rtt40 and 1.8 on local-aac. Its p95 rose on every row, since audio that falls behind is now caught up by speeding up rather than trimmed: the shared clock steps forward as its reference converges through a tune-in backlog, and again when a target falls, and audio follows at the accelerate's pace, which on the replay's constant tone is one 2.5 ms period a window, slower than on speech. bursty-aac rests 5 ms behind its clock, so its p50 of 10.4 ms is mostly its catch-ups, and relay-mic-stall's p50 of 66.1 ms is the catch-up after its target falls from 1540 to 80 ms, which outlasts half the row. In exchange nothing is trimmed: relay-mic-stall's trimmed_ms_per_min fell from 2152.5 to 0, its skips from 6.1 to 0, and its underruns from 24.2 to 0 a minute, and player_underruns_per_min fell from 12.1 to 4 on local-aac, 16.1 to 0 on relay-bbb, 6.1 to 0 on relay-mic, 10.6 to 2.7 on relay-mic-rtt40 and 6.1 to 4 on relay-mic-stall, holding at 4.4 on bursty-aac. The tap now files 3.3 to 6.1 short quanta a minute on the AAC rows, under 0.3 ms of missing audio, where it filed none. To deliver the audio a stall delays, the container consumer now waits and skips at the subscription's max delay, as native already does, rather than at the delay plus lookahead. relay-mic-rtt40's join backlog arrives reordered, so the consumer now waits on its holes and the estimator observes the frames that fill them, up to 775 ms late, and its target p95 returns from 320 to 780 ms, held for one half-life after the join. Later on 2026-11-11 audio began skipping as far as the shared clock's reference moves earlier, once those moves add up to one stretch window and only as far as it holds audio past its target, rather than speeding through them, and every replay row was re-measured. The tune-in backlog's jumps now land before the graded window, so the A/V lag p95 fell from 453.1 to 2.1 ms on relay-bbb (its p50 from 0.4 to -1.3), 743.7 to 1.9 on relay-mic-rtt40, whose p50 fell from 1.2 to 0.4 and its tap's missing audio rose from 0.6 to 0.9 ms a minute, since a jump past what is decoded skips the rest once it lands,, 335.5 to 39.2 on local-aac and 88.6 to 0.3 on relay-mic, and the p50 from 66.1 to 25.3 on relay-mic-stall, with nothing trimmed in any graded window. The tap's underruns fell from 6.1 to 2 a minute on local-aac and 6.1 to 0 on relay-bbb; local-aac's silence rose from 0.001 to 0.002. Later on 2026-11-11 the container consumer began waiting on a missing group only for the delay plus the lookahead, while still delivering groups that arrived until they age past the max delay, and every replay row was re-measured. relay-mic-rtt40's target p95 fell from 780 back to 320 ms, since the holes in its reordered join backlog no longer delay the frames behind them; its tap's missing audio rose from 0.9 to 1.1 ms a minute and its A/V lag p50 and p95 from 0.4 and 1.9 to 0.7 and 2.4 ms. bursty-aac's silence rose from 0.007 to 0.009 and its A/V lag p95 fell from 162.1 to 156.3 ms, and relay-bbb's lag p50 and p95 moved from -1.3 and 2.1 to -1.2 and 2.2 ms. relay-mic-stall did not move. Also on 2026-11-11 the stretch became a player setting, 2 s by default, and the audio subscription's max delay became the delay plus it rather than the 2 s constant, so the container consumer delivers a late group that much longer before it ages out, and every replay row was re-measured: only relay-mic moved, its A/V lag p50 and p95 from 0.3 to 1.6 ms, under the 2.5 ms pitch period the stretch can move it by. Holding the constant max delay with the new bound reproduces the old values exactly. On 2026-11-12 the replays stopped playing a constant and began playing a seeded speech-like signal (syllables gliding a 90 to 220 Hz fundamental, with pauses held above the silence classifier), since the stretch's pitch search found only its shortest period in a constant, and the browser ring stopped zero-filling a hole of up to a millisecond and two samples between frames, as native stopped writing silence for one: the recorded AAC timestamps land up to 2.5 samples either side of a 1024-sample boundary, and on speech the 2-sample holes this filled ended 119.1 quanta a minute short on bursty-aac. Every replay row was re-measured. The tap's underruns fell to 0 on bursty-aac (from 3.3) and local-aac (from 2), and relay-mic-rtt40's missing audio from 1.1 to 0.3 ms a minute while its player underruns rose from 2.7 to 3.1. The A/V lag p95 fell from 156.3 to 104.8 ms on bursty-aac, 39.2 to 15.1 on local-aac, 2.2 to 1.4 on relay-bbb and 501.8 to 484.9 on relay-mic-stall, whose p50 fell from 25.3 to 1.1, and rose from 1.6 to 3.4 on relay-mic and 2.4 to 3.5 on relay-mic-rtt40. Where audio rests moved within one speech pitch period, which is as close as one stretch seam can steer it: the p50 is 11 ms on bursty-aac (from 10.4), -4.2 on relay-bbb (from -1.2), 1.1 on relay-mic (from 1.6), 0.9 on relay-mic-rtt40 (from 0.7) and 1.7 on local-aac (from 1.8). On 2026-11-13 the stretch default fell from 2 s to 200 ms and audio trailing the clock past it began skipping onto the clock rather than back to the bound, as video skips, with the audio subscription still reaching 2 s past the delay; every replay row was re-measured. A target fall past 200 ms now costs one skip rather than seconds of catch-up, and so does a trail past it, and a rise past it pads silence until the clock arrives rather than slowing down: relay-mic-stall skips the 1.46 s it trails after the outage and its 1540 to 1020 and 1020 to 80 ms falls, and pads the 0.5 s its 60 to 1540 ms rise leaves it ahead, where it slowed down for 4 s, so it trims 4678.2 ms a minute where it trimmed none and its stalled share rose from 0.05 to 0.067 and silence from 0.049 to 0.085. The frames it holds through the outage then trickle in at twice real time, so its low buffer slows it to 154 ms behind the clock, where it had sat ahead of it: its A/V lag p95 fell from 484.9 to 118.6 ms and its p50 rose from 1.1 to 2.2. relay-mic-rtt40 skips its 320 to 80 ms fall, 0.3 skips and 83.3 trimmed ms a minute, its p95 from 3.5 to 2.9 ms. bursty-aac skips a 225 ms trail 6 s in, 1.1 skips and 312.7 trimmed ms a minute, its p95 from 102.7 to 49.2 ms and p50 from 11 to 10. relay-mic trims nothing, but its tune-in's skips land on the clock rather than at the bound, which moves where it rests within a pitch period: its p50 from 1.1 to 2.2 ms and p95 from 3.4 to 4.5. Trimming at a target fall or a trail past 200 ms is the rule, not a regression. Also on 2026-11-13, for the same change, the congestion rows' trimmed_ms_per_min ceilings were raised by the same rule from two runs of each on a loaded developer host (x86_64 Linux, the debug build, seed 7, 60 s a row): to 3800 on chromium AAC (worst 2740.3 ms/min), 3700 on chromium Opus (2697.2), 3900 on native AAC (2996.9) and 4600 on native Opus (3532.3), whose player_skips_per_min rose to 15 (9.8). The trim is the outage's audio skipped onto the clock rather than played seconds late: against main on the same host, chromium's A/V lag p95 fell from 1396.8 to 61.6 ms on AAC and 1424.8 to 64.3 on Opus, and native's from 1246.3 to 116.7 and 826.9 to 117.5. These four ceilings are provisional until the nightly re-measures the congestion rows. Also on 2026-11-13, the estimator began counting one outage, the intervals its stalled frames span and the empty ones before them, as one observation, and every replay row was re-measured on top of the snap: only relay-mic-stall moved. Its single stall no longer raises the target, so its target p95 fell from 1540 to 80 ms and the trail the outage leaves is skipped onto the clock at once rather than through the target's falls: 2 skips a minute where it took 6.1, 5122.3 trimmed ms a minute where it trimmed 4678.2, and its A/V lag p95 from 118.6 to 19.7 ms. With 80 ms of buffer rather than 1540, more of the outage plays as silence: its stalled share rose from 0.067 to 0.092 and silence from 0.085 to 0.092.", "rows": [ { "runtime": "chromium", @@ -507,15 +507,15 @@ "rate": 48000, "profile": "relay-mic-stall", "player_underruns_per_min": 4, - "player_skips_per_min": 6.1, + "player_skips_per_min": 2, "underruns_per_min": 0, "underrun_ms_per_min": 0, - "trimmed_ms_per_min": 4678.2, - "stalled_share": 0.067, - "silence_share": 0.085, - "target_ms_p95": 1540, + "trimmed_ms_per_min": 5122.3, + "stalled_share": 0.092, + "silence_share": 0.092, + "target_ms_p95": 80, "av_lag_ms_p50": 2.2, - "av_lag_ms_p95": 118.6 + "av_lag_ms_p95": 19.7 } ] }