1 2015-11-02T00:01:19 *** tommygunner has quit IRC
2 2015-11-02T00:01:40 *** frank1eCrockett has quit IRC
3 2015-11-02T00:02:36 *** frank1e_ is now known as frank1e
4 2015-11-02T00:03:01 *** frank1e has joined #bitcoin-dev
5 2015-11-02T00:03:03 *** grs has joined #bitcoin-dev
6 2015-11-02T00:03:25 *** tommygunner has joined #bitcoin-dev
7 2015-11-02T00:03:39 *** grs is now known as Guest30091
8 2015-11-02T00:03:46 *** owlhooter has quit IRC
9 2015-11-02T00:03:49 *** tommygunner is now known as Guest8017
10 2015-11-02T00:04:17 *** noobfikt has quit IRC
11 2015-11-02T00:10:10 *** dgenr8 has quit IRC
12 2015-11-02T00:10:38 *** dgenr8 has joined #bitcoin-dev
13 2015-11-02T00:10:55 *** rodkeys has joined #bitcoin-dev
14 2015-11-02T00:11:15 *** gazab has quit IRC
15 2015-11-02T00:12:19 *** gazab has joined #bitcoin-dev
16 2015-11-02T00:13:09 *** noobfikt has joined #bitcoin-dev
17 2015-11-02T00:21:58 *** Happzz has quit IRC
18 2015-11-02T00:22:29 *** Happzz has joined #bitcoin-dev
19 2015-11-02T00:23:22 *** frank1e has quit IRC
20 2015-11-02T00:26:46 *** noobfikt has quit IRC
21 2015-11-02T00:28:08 *** Meeh has quit IRC
22 2015-11-02T00:29:26 *** Meeh has joined #bitcoin-dev
23 2015-11-02T00:32:31 *** zooko has quit IRC
24 2015-11-02T00:33:19 *** s7r has quit IRC
25 2015-11-02T00:33:40 *** s7r has joined #bitcoin-dev
26 2015-11-02T00:35:06 *** zooko has joined #bitcoin-dev
27 2015-11-02T00:40:13 *** noobfikt has joined #bitcoin-dev
28 2015-11-02T00:41:44 <xMopxShell> jgarzik: fixed a thing in your lib. https://github.com/jgarzik/python-bitcoinrpc/pull/55
29 2015-11-02T00:41:54 *** zooko has quit IRC
30 2015-11-02T00:48:06 *** noobfikt has joined #bitcoin-dev
31 2015-11-02T00:52:08 *** c-cex-yuriy has quit IRC
32 2015-11-02T00:52:50 *** noobfikt has quit IRC
33 2015-11-02T00:54:54 *** hmsimha_ has quit IRC
34 2015-11-02T00:57:23 *** won9 has quit IRC
35 2015-11-02T00:57:25 *** tawar has joined #bitcoin-dev
36 2015-11-02T00:59:49 *** agricocb has joined #bitcoin-dev
37 2015-11-02T01:02:56 *** afk11 has quit IRC
38 2015-11-02T01:06:24 *** Palsson has joined #bitcoin-dev
39 2015-11-02T01:13:12 *** owlhooter has joined #bitcoin-dev
40 2015-11-02T01:13:35 *** CheckDavid has quit IRC
41 2015-11-02T01:15:42 *** Guest73396 has joined #bitcoin-dev
42 2015-11-02T01:16:01 *** arhuaco has quit IRC
43 2015-11-02T01:33:44 *** kgk has joined #bitcoin-dev
44 2015-11-02T01:37:08 *** belcher has quit IRC
45 2015-11-02T01:37:40 *** Burrito has quit IRC
46 2015-11-02T01:38:53 *** kgk has quit IRC
47 2015-11-02T01:42:47 *** deepcore has quit IRC
48 2015-11-02T01:43:30 *** Guest73396 has quit IRC
49 2015-11-02T01:50:45 *** evoskuil has quit IRC
50 2015-11-02T01:54:04 *** deepcore has joined #bitcoin-dev
51 2015-11-02T01:54:15 *** snthsnth has quit IRC
52 2015-11-02T01:54:22 *** Ylbam has quit IRC
53 2015-11-02T02:04:26 *** Palsson has quit IRC
54 2015-11-02T02:04:43 *** evoskuil has joined #bitcoin-dev
55 2015-11-02T02:05:09 *** Palsson has joined #bitcoin-dev
56 2015-11-02T02:12:15 *** one_zero has joined #bitcoin-dev
57 2015-11-02T02:18:41 *** p15 has joined #bitcoin-dev
58 2015-11-02T02:27:08 *** snthsnth has joined #bitcoin-dev
59 2015-11-02T02:33:46 *** NewLiberty has quit IRC
60 2015-11-02T02:34:03 *** zooko has joined #bitcoin-dev
61 2015-11-02T02:36:51 *** nessence has joined #bitcoin-dev
62 2015-11-02T02:37:14 *** Guest73396 has joined #bitcoin-dev
63 2015-11-02T02:41:41 *** porquilho has quit IRC
64 2015-11-02T02:42:55 *** deepcore has quit IRC
65 2015-11-02T02:47:24 *** Yoghur114 has quit IRC
66 2015-11-02T02:47:59 *** snthsnth has quit IRC
67 2015-11-02T02:48:06 *** xiangfu has joined #bitcoin-dev
68 2015-11-02T02:49:24 *** frank1e has joined #bitcoin-dev
69 2015-11-02T03:00:48 *** rnvk has joined #bitcoin-dev
70 2015-11-02T03:04:42 *** alex_____ has joined #bitcoin-dev
71 2015-11-02T03:05:50 *** mountaingoat has quit IRC
72 2015-11-02T03:10:03 *** complexring has quit IRC
73 2015-11-02T03:10:28 *** complexring has joined #bitcoin-dev
74 2015-11-02T03:16:15 *** lewellyn has quit IRC
75 2015-11-02T03:16:26 *** frank1e_ has joined #bitcoin-dev
76 2015-11-02T03:16:48 *** lewellyn has joined #bitcoin-dev
77 2015-11-02T03:19:25 *** frank1e has quit IRC
78 2015-11-02T03:22:02 *** mountaingoat has joined #bitcoin-dev
79 2015-11-02T03:28:18 *** padxni has quit IRC
80 2015-11-02T03:30:06 *** rusty has quit IRC
81 2015-11-02T03:37:47 *** antizionist__ has quit IRC
82 2015-11-02T03:38:35 *** rodkeys has quit IRC
83 2015-11-02T03:52:14 *** frank1e_ is now known as frank1e
84 2015-11-02T03:52:26 *** frank1e has joined #bitcoin-dev
85 2015-11-02T03:53:35 *** Delta_ has joined #bitcoin-dev
86 2015-11-02T03:55:31 *** Subo1977 has quit IRC
87 2015-11-02T03:56:07 *** jouke has quit IRC
88 2015-11-02T03:56:19 *** frank1e has quit IRC
89 2015-11-02T03:56:36 *** nessence has quit IRC
90 2015-11-02T03:56:57 *** jouke has joined #bitcoin-dev
91 2015-11-02T03:57:06 *** nessence has joined #bitcoin-dev
92 2015-11-02T04:01:26 *** nessence has quit IRC
93 2015-11-02T04:04:01 *** hmsimha_ has joined #bitcoin-dev
94 2015-11-02T04:04:59 *** lnostdal__ has quit IRC
95 2015-11-02T04:06:02 *** xiangfu has quit IRC
96 2015-11-02T04:06:47 *** xiangfu has joined #bitcoin-dev
97 2015-11-02T04:08:52 *** nessence has joined #bitcoin-dev
98 2015-11-02T04:09:12 *** hmsimha_ has quit IRC
99 2015-11-02T04:10:23 *** rolandnsharp has quit IRC
100 2015-11-02T04:10:39 *** rolandnsharp has joined #bitcoin-dev
101 2015-11-02T04:16:08 *** Aido has quit IRC
102 2015-11-02T04:19:21 *** Aido has joined #bitcoin-dev
103 2015-11-02T04:19:30 *** lnostdal__ has joined #bitcoin-dev
104 2015-11-02T04:24:23 *** alex_____ has quit IRC
105 2015-11-02T04:28:12 *** aburan28 has quit IRC
106 2015-11-02T04:28:17 *** jrklein has quit IRC
107 2015-11-02T04:28:20 *** daniel___ has quit IRC
108 2015-11-02T04:28:40 *** p15x has joined #bitcoin-dev
109 2015-11-02T04:29:00 *** danielsocials_ has joined #bitcoin-dev
110 2015-11-02T04:31:43 *** rodkeys has joined #bitcoin-dev
111 2015-11-02T04:31:54 *** TheSeven has quit IRC
112 2015-11-02T04:32:06 *** [7] has joined #bitcoin-dev
113 2015-11-02T04:35:17 *** alex_____ has joined #bitcoin-dev
114 2015-11-02T04:38:40 *** alex_____ has quit IRC
115 2015-11-02T04:38:54 *** alex_____ has joined #bitcoin-dev
116 2015-11-02T04:39:34 *** Belxjander has quit IRC
117 2015-11-02T04:40:19 *** Belxjander has joined #bitcoin-dev
118 2015-11-02T04:40:56 *** SamInTampa has joined #bitcoin-dev
119 2015-11-02T04:42:13 *** danielsocials__ has joined #bitcoin-dev
120 2015-11-02T04:42:28 <Luke-Jr> hmm, jl2012's post is making me second-guess the BIP113-is-a-hardfork conclusion
121 2015-11-02T04:43:24 *** danielsocials_ has quit IRC
122 2015-11-02T04:45:56 <sipa> link?
123 2015-11-02T04:48:58 <Luke-Jr> http://lists.linuxfoundation.org/pipermail/bitcoin-dev/2015-November/011648.html
124 2015-11-02T04:49:00 *** jzk has quit IRC
125 2015-11-02T04:49:25 <gmaxwell> I also pointed this out on the PR.
126 2015-11-02T04:49:39 <gmaxwell> We swapped the comparison signs for some reason.
127 2015-11-02T04:50:18 <gmaxwell> Locktimes have to be higher than the block times, not the other way around.
128 2015-11-02T04:51:01 <Luke-Jr> eh, I'm confused now.
129 2015-11-02T04:51:14 <Luke-Jr> locktime needs to be lower, no?
130 2015-11-02T04:52:03 <gmaxwell> Right.
131 2015-11-02T04:52:04 *** SamInTampa has left #bitcoin-dev
132 2015-11-02T04:52:46 <gmaxwell> MTP = 100, TX = 150, Block=200. TX is valid under current rules because 200>150. It's not valid yet under MTP because 100<150.
133 2015-11-02T04:53:47 *** kadoban has quit IRC
134 2015-11-02T04:54:08 *** grassass has joined #bitcoin-dev
135 2015-11-02T04:54:31 <sipa> agree
136 2015-11-02T04:54:32 <Luke-Jr> so BIP 113 is fine after all, and somehow I managed to confuse the comparison contageously this morning. :/
137 2015-11-02T04:54:37 <sipa> i swapped it too
138 2015-11-02T04:56:13 <gmaxwell> Time to undo my revert.
139 2015-11-02T04:56:26 <wumpus> I think it's too late for that
140 2015-11-02T04:56:50 <sipa> how so?
141 2015-11-02T04:57:01 <wumpus> apparently we're not quite sure this is correct, we shouldn't have merged it in the first place
142 2015-11-02T04:57:07 <gmaxwell> great, I'll just never report a potental problem again. problem solved.
143 2015-11-02T04:57:21 <sipa> i'm convinced it is correct now
144 2015-11-02T04:58:00 <Luke-Jr> I agree it's scary that today happened, but I don't know we can possibly get a higher QA than we had, on anything.
145 2015-11-02T04:58:01 *** jzk has joined #bitcoin-dev
146 2015-11-02T04:58:03 <sipa> not sure how i misread it even; the code is obvious
147 2015-11-02T04:58:05 <Luke-Jr> we're hitting the limits of practicality.
148 2015-11-02T04:58:18 <wumpus> at least i think we should wait a bit before doing this again. It seems too scary
149 2015-11-02T04:58:30 <wumpus> we almost had an inadvertent hardfork
150 2015-11-02T04:58:40 <gmaxwell> Except we didn't.
151 2015-11-02T04:58:51 <gmaxwell> (didn't almost, I mean)
152 2015-11-02T04:58:53 <wumpus> yeah near-miss / near-hit ...
153 2015-11-02T05:00:26 <gmaxwell> wumpus: luke was confused and confused sipa and I didn't question it seriously enough unti later because I was so freaked out by what I thought was my error. As soon as I sat down and thought it through I realized it was wrong.
154 2015-11-02T05:01:23 *** Guest73396 has quit IRC
155 2015-11-02T05:01:28 <gmaxwell> Also, even if this were wrong, it was mempool only and wouldn't have been a hardfork.
156 2015-11-02T05:01:36 <wumpus> I understand. I have no solution for this either :-/ Just seems to risky at some point to change even anything :(
157 2015-11-02T05:02:05 <gmaxwell> At worst it would have caused a DOS when createnewblock failed and crashed all the miners with this code. :)
158 2015-11-02T05:02:09 <sipa> in IsFinalTx there is "if tx.nLockTime < (expression representing block time) return true;"... this PR decreases the value of that expression, so it can only stop returning true
159 2015-11-02T05:02:23 <Luke-Jr> IMO lesson should be to not be so quick to revert things, especially when they have lots of qualified ACKs.
160 2015-11-02T05:02:31 <wumpus> I mean, what if we now decide it is safe, but a day later there's yet another problem
161 2015-11-02T05:03:07 <gmaxwell> Luke-Jr: I disagree.
162 2015-11-02T05:03:12 <sipa> how about just seeing this as a recognition that review sometimes fails
163 2015-11-02T05:03:31 <sipa> but we're rather overly cautious than the other way around
164 2015-11-02T05:03:43 <Luke-Jr> gmaxwell: had we given it 24 hours to think on, you and jl2012 would have noticed before the revert happened..
165 2015-11-02T05:03:54 <gmaxwell> Luke-Jr: I thought it was good to revert it soon because under that misunderstanding git master would randomly crash when mining.
166 2015-11-02T05:04:11 <gmaxwell> Luke-Jr: sure, but no harm in reverting unless the consequence is that we won't put it back after more consideration.
167 2015-11-02T05:04:11 <wumpus> right, now that it was still mempool only it couldn't cause a hardfork, so it wasn't that urgent yet
168 2015-11-02T05:04:28 <Luke-Jr> people should not be mining on git master O.o
169 2015-11-02T05:04:32 <wumpus> but it looked like a panic so I merged it immediately
170 2015-11-02T05:04:41 <gmaxwell> I think wumpus did right.
171 2015-11-02T05:05:06 <gmaxwell> wumpus: yea, thats part of the motivation of mempool only; to get things in use before they are a consensus rule.. so if something is wrong it isn't the end of the world.
172 2015-11-02T05:05:08 <wumpus> I was just awake, wasn't aware of the whole context, and these things give me nightmares
173 2015-11-02T05:05:26 *** frank1e has joined #bitcoin-dev
174 2015-11-02T05:05:36 <sipa> i think it's perfectly reasonable to revert given doubt
175 2015-11-02T05:05:42 <Belxjander> is there any documented list of the consensus rules outside the codebase ?
176 2015-11-02T05:05:50 <sipa> Belxjander: no
177 2015-11-02T05:05:57 <gmaxwell> Luke-Jr: as far as "can possibly get a higher"; well if this had better tests my response woud have been "Then how do the tests pass?"
178 2015-11-02T05:06:04 <sipa> but it's also perfectly reasonable to revert the revert now the doubt has disappeared
179 2015-11-02T05:06:11 <sipa> i had never reviewed this code, i think
180 2015-11-02T05:06:27 <wumpus> I don't think this revert should mean we should never put it back after consideration, but it is a warning to be careful and not over-hasty
181 2015-11-02T05:07:12 <gmaxwell> I complained about this code being hard to review when it went up; so when sipa said it was wrong and gave a plausable explination, I went and saw there were no tests that would preclude that, and wrote the revert so we wouldn't end up with some genius mining on master having a bad day. :)
182 2015-11-02T05:07:37 <wumpus> to me this is another signal that BIP113, in the current impelmentation, isn't ready for primetime yet
183 2015-11-02T05:08:29 <gmaxwell> wumpus: I don't think so-- I mean the confusion here wasn't in 113 itself.
184 2015-11-02T05:09:37 <gmaxwell> I was hasty because I though I must not have reviewed it sufficiently because I did not like the use of max() on flags, and I was ashamed of doing a bad job and wanted to fix it ASAP.
185 2015-11-02T05:10:20 <gmaxwell> Thats basically all that went through my mind when sipa said he thought it was wrong; that sort of thing gives me nightmares too.
186 2015-11-02T05:10:35 *** Giszmo has quit IRC
187 2015-11-02T05:10:45 <Luke-Jr> it presumably received code-review ACKs from: CodeShark, btcdrak, rusty, instagibbs, jmcorgan, afk11, rubensayshi, petertodd, jtimon, and myself. I guess it could have waited for more, but that's not a trivial amount of ACKs, even if we ignore the names I don't recognise..
188 2015-11-02T05:10:53 <wumpus> sounds like a reasonable issue - probably should have been fixed before merging
189 2015-11-02T05:12:05 <wumpus> (though the flags were hardcoded at this point so at least that couldn't have given issues yet)
190 2015-11-02T05:12:13 <gmaxwell> Well for things like that I dunno when I'm being picky vs it being an actual issue. But in any case, it was unrelated to the issue here. The confusion that hit sipa and Luke-Jr was just a fundimental confusion with respect to how locktime was working; it was not the fault of this code; which couldn't have possibly been more clear on this point.
191 2015-11-02T05:14:05 <gmaxwell> wumpus: yes, the flags are just staic, so that code was doing nothing. I only mentioned it because I know from expirence that I review less after hitting the first nit. (usually because I expect the nit to get fixed, and then I review again.) So I thought I must have done that here.
192 2015-11-02T05:14:10 *** nivah has quit IRC
193 2015-11-02T05:16:19 <Luke-Jr> (FWIW, my confusion came 10 days after carefully reviewing and ACKing it, and I was biased toward finding it when I actually tried to confirm it in the code.)
194 2015-11-02T05:17:03 <gmaxwell> In any case, as a matter of principle, we shouldn't avoid undoing an over eager revert; because we'd rather be over-eager with reverts than not. We shouldn't give ourselves another reason to not revert something.
195 2015-11-02T05:17:45 <wumpus> gmaxwell: yeah we're all imperfect with reviewing, the only hope is that having lots of people look at it will increase the coverage to a point where the risk is acceptable...
196 2015-11-02T05:18:12 <gmaxwell> It's a positive sign, I guess, if we get some false positives on code being wrong.
197 2015-11-02T05:18:24 <wumpus> at least people are looking!
198 2015-11-02T05:18:45 <gmaxwell> not just looking but willing to call out doubts!
199 2015-11-02T05:25:37 *** roxtrongo has joined #bitcoin-dev
200 2015-11-02T05:27:21 *** epopt has joined #bitcoin-dev
201 2015-11-02T05:28:03 *** remiah has joined #bitcoin-dev
202 2015-11-02T05:30:38 *** sparetire_ has quit IRC
203 2015-11-02T05:35:29 *** kgk has joined #bitcoin-dev
204 2015-11-02T05:35:39 *** zooko has quit IRC
205 2015-11-02T05:36:46 *** metalcamp has joined #bitcoin-dev
206 2015-11-02T05:40:18 *** kgk has quit IRC
207 2015-11-02T05:40:54 *** xiangfu has quit IRC
208 2015-11-02T05:43:37 *** p15x has quit IRC
209 2015-11-02T05:44:30 *** bedeho has joined #bitcoin-dev
210 2015-11-02T05:44:59 <remiah> thats a coinya
211 2015-11-02T05:46:08 *** nivah has joined #bitcoin-dev
212 2015-11-02T05:47:49 <phantomcircuit> gmaxwell, possibly the logic should keep the check to explicitly require the locktime be less than the block time for clarity (yes it's checking twice then)
213 2015-11-02T05:48:41 *** xiangfu has joined #bitcoin-dev
214 2015-11-02T06:02:52 *** bit2017 has joined #bitcoin-dev
215 2015-11-02T06:04:43 *** bit2017 has joined #bitcoin-dev
216 2015-11-02T06:06:24 *** nivah has quit IRC
217 2015-11-02T06:07:25 *** roxtrongo has quit IRC
218 2015-11-02T06:08:07 *** Guest35844 has quit IRC
219 2015-11-02T06:09:04 *** Madars has quit IRC
220 2015-11-02T06:11:15 *** neozaru has joined #bitcoin-dev
221 2015-11-02T06:15:16 *** supasonic has joined #bitcoin-dev
222 2015-11-02T06:18:23 *** Madars has joined #bitcoin-dev
223 2015-11-02T06:21:11 *** CodeShark has joined #bitcoin-dev
224 2015-11-02T06:27:35 *** danielsocials has joined #bitcoin-dev
225 2015-11-02T06:29:22 *** ParadoxSpiral has joined #bitcoin-dev
226 2015-11-02T06:30:47 *** pigeons has joined #bitcoin-dev
227 2015-11-02T06:31:10 *** pigeons is now known as Guest7284
228 2015-11-02T06:31:37 *** danielsocials__ has quit IRC
229 2015-11-02T06:32:11 *** danielsocials_ has joined #bitcoin-dev
230 2015-11-02T06:40:40 *** sinetek has quit IRC
231 2015-11-02T06:41:23 *** frank1e has quit IRC
232 2015-11-02T06:47:26 *** p15x has joined #bitcoin-dev
233 2015-11-02T06:49:44 *** ParadoxSpiral has quit IRC
234 2015-11-02T06:51:49 *** Transisto2 has joined #bitcoin-dev
235 2015-11-02T06:52:03 *** Transisto2 has joined #bitcoin-dev
236 2015-11-02T06:54:27 *** p15x has quit IRC
237 2015-11-02T06:59:41 *** romonster has quit IRC
238 2015-11-02T07:00:06 *** missmogg has quit IRC
239 2015-11-02T07:00:27 *** lewellyn has quit IRC
240 2015-11-02T07:05:19 *** melvster has quit IRC
241 2015-11-02T07:06:23 *** romonster has joined #bitcoin-dev
242 2015-11-02T07:06:57 *** lewellyn has joined #bitcoin-dev
243 2015-11-02T07:06:59 *** missmogg has joined #bitcoin-dev
244 2015-11-02T07:12:11 *** lewellyn has quit IRC
245 2015-11-02T07:12:42 *** missmogg has quit IRC
246 2015-11-02T07:12:51 *** missmogg has joined #bitcoin-dev
247 2015-11-02T07:13:44 *** lewellyn has joined #bitcoin-dev
248 2015-11-02T07:14:55 *** deepcore has joined #bitcoin-dev
249 2015-11-02T07:17:02 *** paulo_ has joined #bitcoin-dev
250 2015-11-02T07:18:56 *** melvster has joined #bitcoin-dev
251 2015-11-02T07:28:12 *** splix has joined #bitcoin-dev
252 2015-11-02T07:28:37 *** DougieBot5000 has quit IRC
253 2015-11-02T07:29:35 *** deepcore has quit IRC
254 2015-11-02T07:29:40 *** rodmar has joined #bitcoin-dev
255 2015-11-02T07:30:01 *** won9 has joined #bitcoin-dev
256 2015-11-02T07:31:29 *** Ylbam has joined #bitcoin-dev
257 2015-11-02T07:32:05 *** rodmar has quit IRC
258 2015-11-02T07:33:26 *** neozaru has quit IRC
259 2015-11-02T07:33:49 *** rusty has joined #bitcoin-dev
260 2015-11-02T07:33:59 *** Squidicc has joined #bitcoin-dev
261 2015-11-02T07:34:00 *** Squidicuz has quit IRC
262 2015-11-02T07:34:00 *** stapler117 has quit IRC
263 2015-11-02T07:34:01 *** stapler118 has joined #bitcoin-dev
264 2015-11-02T07:34:13 *** Guest73396 has joined #bitcoin-dev
265 2015-11-02T07:37:13 *** Yoghur114 has joined #bitcoin-dev
266 2015-11-02T07:37:25 *** kgk has joined #bitcoin-dev
267 2015-11-02T07:37:28 *** morcos has quit IRC
268 2015-11-02T07:38:29 *** morcos has joined #bitcoin-dev
269 2015-11-02T07:38:53 *** rodkeys has quit IRC
270 2015-11-02T07:42:15 *** kgk has quit IRC
271 2015-11-02T07:44:33 *** ThomasV has joined #bitcoin-dev
272 2015-11-02T07:45:15 *** metalcamp has quit IRC
273 2015-11-02T07:46:20 *** paveljanik has quit IRC
274 2015-11-02T07:46:46 *** rusty has quit IRC
275 2015-11-02T07:47:18 *** remiah has quit IRC
276 2015-11-02T07:50:51 *** bit2017 has quit IRC
277 2015-11-02T07:51:04 *** noamh_ has quit IRC
278 2015-11-02T07:55:35 *** gill3s has joined #bitcoin-dev
279 2015-11-02T07:58:06 *** Belxjander has quit IRC
280 2015-11-02T07:59:06 *** CodesInChaos has quit IRC
281 2015-11-02T08:02:28 *** won9 has quit IRC
282 2015-11-02T08:02:34 *** ThomasV has quit IRC
283 2015-11-02T08:03:31 *** won9 has joined #bitcoin-dev
284 2015-11-02T08:03:34 *** Belxjander has joined #bitcoin-dev
285 2015-11-02T08:04:19 *** melvster has quit IRC
286 2015-11-02T08:06:35 *** moa has joined #bitcoin-dev
287 2015-11-02T08:11:41 *** CodesInChaos has joined #bitcoin-dev
288 2015-11-02T08:13:15 *** IAmNotDorian has joined #bitcoin-dev
289 2015-11-02T08:16:25 <btcdrak> wumpus: I think the lesson learned is about being overhasty the other way. There was a group hallucination that there was a problem that didnt really exist. We cant behave as if we just narrowly escaped an inadvertent hardfork. We had a bad dream, and now we woke up from it, nothing happened.
290 2015-11-02T08:17:58 *** melvster has joined #bitcoin-dev
291 2015-11-02T08:18:20 <phantomcircuit> btcdrak, the logic is confusing, which is a bug
292 2015-11-02T08:18:28 <phantomcircuit> it needs to be obvious that there isn't a bug
293 2015-11-02T08:18:40 <btcdrak> I think we could probably do with some better comments in the code.
294 2015-11-02T08:18:45 <moa> unsubsribing from the hallucination group
295 2015-11-02T08:19:17 <btcdrak> but we should unrevert the revert and add some explicit comments, It will be useful for people in the future anyhow to understand the code.
296 2015-11-02T08:19:22 *** bapalm has quit IRC
297 2015-11-02T08:21:45 *** n0n0_ has joined #bitcoin-dev
298 2015-11-02T08:22:50 <gmaxwell> phantomcircuit: I don't think the change itself was confusing.
299 2015-11-02T08:24:18 *** bapalm has joined #bitcoin-dev
300 2015-11-02T08:27:39 *** roxtrongo has joined #bitcoin-dev
301 2015-11-02T08:29:18 <sipa> ... i still have difficulty reasoning about it
302 2015-11-02T08:30:10 <sipa> somehow, every time i start thinking about it, it seems that by making block time stamps earlier, it's going to allow transactions to unlock sooner
303 2015-11-02T08:30:19 *** hashtag_ has quit IRC
304 2015-11-02T08:30:35 <sipa> by doing the math, and looking at the cide, i am convinced the change is safe
305 2015-11-02T08:30:43 <sipa> but my intuition still says the opposite
306 2015-11-02T08:31:32 *** xolokram has joined #bitcoin-dev
307 2015-11-02T08:33:08 <gmaxwell> sipa: do you also think that if I set your clock earlier that you will think it is time to go home from work earlier?
308 2015-11-02T08:34:05 *** roxtrongo has quit IRC
309 2015-11-02T08:34:23 <phantomcircuit> gmaxwell, it's only obvious if you're thinking about the median time of the previous 11 blocks being the minimum block time
310 2015-11-02T08:34:32 <CodeShark> does sipa ever go home from work? :)
311 2015-11-02T08:34:41 <sipa> gmaxwell: are you saying there is an hour at which i can stop working whatsoever?
312 2015-11-02T08:35:04 <gmaxwell> I didn't say anything about stopping working, I said go home.
313 2015-11-02T08:35:17 <gmaxwell> you know, because the cleaning people show up and are distracting.
314 2015-11-02T08:35:46 <sipa> gmaxwell: of course not; but it does require a mental "wait, why did that work again?" every timr
315 2015-11-02T08:35:52 <gmaxwell> Some have hypotheized that life continues if you stop working, but this sounds like too dangerous an expirement to me. :)
316 2015-11-02T08:39:02 *** arowser has joined #bitcoin-dev
317 2015-11-02T08:39:36 <sipa> anyway, i'm bad with time. i can't even read an analogue clock, you shouldn't trust me to review time things!
318 2015-11-02T08:39:49 <wumpus> btcdrak: agreed - I didn't mean to say we narrowly escaped from a hard fork, but it was a good reminder that it can happen
319 2015-11-02T08:41:37 <CodeShark> sipa: I think the key intuition here is that the locktime cannot be sandwiched between blocktime and mtp
320 2015-11-02T08:42:30 <CodeShark> then to consider the symmetry of swapping mtp and blocktime
321 2015-11-02T08:42:45 <sipa> CodeShark: of course it can be, but in the safe direction, not the unsafe one
322 2015-11-02T08:42:57 <CodeShark> right :)
323 2015-11-02T08:43:21 <wumpus> gmaxwell: hah so risk-adverse
324 2015-11-02T08:44:07 <CodeShark> in any case, it's only the cases where it's sandwiched that are interesting :)
325 2015-11-02T08:46:19 *** alex_____ has quit IRC
326 2015-11-02T08:48:38 *** Grouver has joined #bitcoin-dev
327 2015-11-02T08:50:24 *** arowser has left #bitcoin-dev
328 2015-11-02T08:53:28 *** marathon has joined #bitcoin-dev
329 2015-11-02T08:54:26 *** trixisowned has quit IRC
330 2015-11-02T08:55:29 *** xiangfu has quit IRC
331 2015-11-02T08:55:44 *** xiangfu has joined #bitcoin-dev
332 2015-11-02T09:00:04 *** tarantillo_ has quit IRC
333 2015-11-02T09:00:20 *** tarantillo_ has joined #bitcoin-dev
334 2015-11-02T09:01:44 *** BashCo has quit IRC
335 2015-11-02T09:11:42 *** ThomasV has joined #bitcoin-dev
336 2015-11-02T09:12:04 *** adam3us has joined #bitcoin-dev
337 2015-11-02T09:12:50 *** StormDev has joined #bitcoin-dev
338 2015-11-02T09:15:20 *** StormDev has quit IRC
339 2015-11-02T09:15:49 *** StormDev has joined #bitcoin-dev
340 2015-11-02T09:18:00 <BlueMatt> phantomcircuit: so I had never gotten around to rebasing the mutate-to-low-s branch to mempool limiting...was it you who was asking for that? anyway, its there now...
341 2015-11-02T09:18:49 <phantomcircuit> BlueMatt, yes it was, same branch?
342 2015-11-02T09:19:54 <BlueMatt> yea, "seed"
343 2015-11-02T09:22:01 *** BashCo has joined #bitcoin-dev
344 2015-11-02T09:27:01 *** CoinMuncher has joined #bitcoin-dev
345 2015-11-02T09:29:36 *** splix has quit IRC
346 2015-11-02T09:37:38 *** IAmNotDorian has quit IRC
347 2015-11-02T09:37:53 *** nodee3333 has joined #bitcoin-dev
348 2015-11-02T09:38:25 *** kgk has joined #bitcoin-dev
349 2015-11-02T09:41:31 *** ThomasV has quit IRC
350 2015-11-02T09:42:50 *** kgk has quit IRC
351 2015-11-02T09:44:52 *** paulo_ has quit IRC
352 2015-11-02T09:47:48 *** xiangfu has quit IRC
353 2015-11-02T09:50:51 *** Subo1977 has joined #bitcoin-dev
354 2015-11-02T09:52:14 *** Delta_ has quit IRC
355 2015-11-02T09:52:22 *** noamh has joined #bitcoin-dev
356 2015-11-02T09:56:21 *** c0rw1n_ has joined #bitcoin-dev
357 2015-11-02T09:57:09 *** c0rw1n has quit IRC
358 2015-11-02T09:57:53 *** Guyver2 has joined #bitcoin-dev
359 2015-11-02T10:03:41 *** sparetire_ has joined #bitcoin-dev
360 2015-11-02T10:12:04 *** Alina-malina has joined #bitcoin-dev
361 2015-11-02T10:26:18 <jtimon> btcdrak: +1 on group hallucination, after Luke-Jr sipa and gmaxwell said there was a problem, I was more in a hurry to undesrtand some deployment consequences than in actually undesrtanding why it was a problem: "I can do that tomorrow", I thought. My learned lesson is that I probably trust these guys too much :p
362 2015-11-02T10:28:58 *** matsjj has joined #bitcoin-dev
363 2015-11-02T10:29:33 <btcdrak> jtimon: Remember the words of Ronald Reagan, "Trust but verify!" :))
364 2015-11-02T10:30:42 <btcdrak> anyway, no harm done, and let better err on the side of caution. for me this incident gave me more confidence that people are looking deeply to find issues even post merge.
365 2015-11-02T10:32:26 *** owowo has quit IRC
366 2015-11-02T10:32:35 *** owowo has joined #bitcoin-dev
367 2015-11-02T10:32:36 *** owowo has joined #bitcoin-dev
368 2015-11-02T10:33:59 <jtimon> yep, that's what I thought "sure let's revert and think about this again" when apparently there was a problem, better safe than sorry
369 2015-11-02T10:34:36 *** AaronvanW has joined #bitcoin-dev
370 2015-11-02T10:34:36 *** AaronvanW has quit IRC
371 2015-11-02T10:34:36 *** AaronvanW has joined #bitcoin-dev
372 2015-11-02T10:37:43 *** trixisowned has joined #bitcoin-dev
373 2015-11-02T10:40:28 *** c0rw1n_ is now known as c0rw1n
374 2015-11-02T10:41:17 *** adam3us1 has joined #bitcoin-dev
375 2015-11-02T10:41:17 *** adam3us has quit IRC
376 2015-11-02T10:49:10 *** won9 has quit IRC
377 2015-11-02T10:49:28 *** bedeho has quit IRC
378 2015-11-02T10:52:37 *** adam3us1 has quit IRC
379 2015-11-02T10:53:23 *** won9 has joined #bitcoin-dev
380 2015-11-02T10:56:14 *** Guyver2 has quit IRC
381 2015-11-02T11:05:57 *** damethos has joined #bitcoin-dev
382 2015-11-02T11:10:30 <JWU42> bitcoind: main.cpp:3882: void ProcessGetData(CNode*): Assertion `!"cannot load block from disk"' failed.
383 2015-11-02T11:10:40 <JWU42> most likely a HDD issue ?
384 2015-11-02T11:11:01 <JWU42> smart details are all OK
385 2015-11-02T11:11:11 <JWU42> TIA
386 2015-11-02T11:13:23 *** ThomasV has joined #bitcoin-dev
387 2015-11-02T11:13:40 <JWU42> ok - google agrees - bad blockchain and/or disk issues
388 2015-11-02T11:16:23 *** zubair has joined #bitcoin-dev
389 2015-11-02T11:22:15 *** one_zero has quit IRC
390 2015-11-02T11:23:26 *** Lightsword has quit IRC
391 2015-11-02T11:24:48 *** ThomasKeller has quit IRC
392 2015-11-02T11:25:21 *** ThomasKeller has joined #bitcoin-dev
393 2015-11-02T11:30:33 *** ThomasV has quit IRC
394 2015-11-02T11:30:46 *** Guest73396 has quit IRC
395 2015-11-02T11:37:58 *** mountaingoat has quit IRC
396 2015-11-02T11:39:07 *** mountaingoat has joined #bitcoin-dev
397 2015-11-02T11:39:17 *** padxni has joined #bitcoin-dev
398 2015-11-02T11:39:47 *** marathon has quit IRC
399 2015-11-02T11:40:08 *** kgk has joined #bitcoin-dev
400 2015-11-02T11:40:18 *** adam3us has joined #bitcoin-dev
401 2015-11-02T11:43:19 *** ThomasV has joined #bitcoin-dev
402 2015-11-02T11:44:10 *** kgk has quit IRC
403 2015-11-02T11:48:08 *** StormDev has quit IRC
404 2015-11-02T11:48:40 *** StormDev has joined #bitcoin-dev
405 2015-11-02T11:50:34 <phantomcircuit> JWU42, operating system/
406 2015-11-02T11:50:35 <phantomcircuit> ?
407 2015-11-02T11:51:07 <JWU42> phantomcircuit: linux (ubuntu LTS)
408 2015-11-02T11:51:40 <JWU42> it is a dedicated box that has been running well for over a year but has started to show problems with corruption the last 1-2 months
409 2015-11-02T11:52:06 <JWU42> now it is this issue (after rebuilding the DB 2-3 months back)
410 2015-11-02T11:52:07 *** CheckDavid has joined #bitcoin-dev
411 2015-11-02T11:52:25 <phantomcircuit> JWU42, hardware issue for sure
412 2015-11-02T11:52:38 <JWU42> lovely
413 2015-11-02T11:52:40 <JWU42> =)
414 2015-11-02T11:52:51 <JWU42> thanks for the thoughts
415 2015-11-02T11:52:53 <phantomcircuit> lol yeah
416 2015-11-02T11:53:04 <JWU42> now to argue with the provider
417 2015-11-02T11:53:10 <JWU42> again, thanks
418 2015-11-02T11:53:14 *** adam3us has quit IRC
419 2015-11-02T11:55:33 *** tawar has quit IRC
420 2015-11-02T11:57:36 <wumpus> what version of bitcoin core?
421 2015-11-02T11:59:10 <wumpus> it's most likely a hw issue, although in the past there has been a bug that blocks could be written that overlap after a reindex, but if you're using an up-to-date version that shouldn't happen
422 2015-11-02T12:04:48 *** p15 has quit IRC
423 2015-11-02T12:05:20 *** splix has joined #bitcoin-dev
424 2015-11-02T12:12:45 *** mountaingoat has quit IRC
425 2015-11-02T12:13:00 *** IAmNotDorian has joined #bitcoin-dev
426 2015-11-02T12:13:00 *** IAmNotDorian has joined #bitcoin-dev
427 2015-11-02T12:13:44 *** p15x has joined #bitcoin-dev
428 2015-11-02T12:17:26 *** mountaingoat has joined #bitcoin-dev
429 2015-11-02T12:18:06 *** padxni has quit IRC
430 2015-11-02T12:18:30 *** supasonic has quit IRC
431 2015-11-02T12:18:58 *** supasonic has joined #bitcoin-dev
432 2015-11-02T12:31:01 *** h3xc0d3r has quit IRC
433 2015-11-02T12:31:08 *** roxtrongo has joined #bitcoin-dev
434 2015-11-02T12:31:55 *** won9 has quit IRC
435 2015-11-02T12:33:04 *** h3xc0d3r has joined #bitcoin-dev
436 2015-11-02T12:35:59 *** roxtrongo has quit IRC
437 2015-11-02T12:36:30 *** supasonic has quit IRC
438 2015-11-02T12:38:40 *** AMERICAN_PSYCHO has joined #bitcoin-dev
439 2015-11-02T12:38:54 *** Giszmo has joined #bitcoin-dev
440 2015-11-02T12:41:25 *** spinza has quit IRC
441 2015-11-02T12:43:31 <instagibbs> I wasn't around this weekend much, but I should have realized that my tests I ran for mtp disproved the hardfork theory. Oh well.
442 2015-11-02T12:44:53 *** StormDev has quit IRC
443 2015-11-02T12:45:18 *** StormDev has joined #bitcoin-dev
444 2015-11-02T12:46:12 *** spinza has joined #bitcoin-dev
445 2015-11-02T12:48:47 *** metalcamp has joined #bitcoin-dev
446 2015-11-02T12:56:47 *** afk11 has joined #bitcoin-dev
447 2015-11-02T13:02:18 *** ParadoxSpiral has joined #bitcoin-dev
448 2015-11-02T13:03:11 <jgarzik> instagibbs, mtp?
449 2015-11-02T13:03:23 *** blazeme8 has quit IRC
450 2015-11-02T13:04:03 *** Guyver2 has joined #bitcoin-dev
451 2015-11-02T13:04:24 *** Guyver2 has joined #bitcoin-dev
452 2015-11-02T13:04:44 *** Guyver2 has joined #bitcoin-dev
453 2015-11-02T13:04:54 *** xMopxShell has quit IRC
454 2015-11-02T13:05:04 *** Guyver2 has joined #bitcoin-dev
455 2015-11-02T13:05:27 *** Guyver2 has joined #bitcoin-dev
456 2015-11-02T13:08:47 <phantomcircuit> jgarzik, bip 113 stuff
457 2015-11-02T13:14:50 *** Starsocceraway has joined #bitcoin-dev
458 2015-11-02T13:15:38 *** starsoccer has quit IRC
459 2015-11-02T13:16:25 *** Starsocceraway has quit IRC
460 2015-11-02T13:16:25 *** Starsocceraway has joined #bitcoin-dev
461 2015-11-02T13:18:04 *** rnvk has quit IRC
462 2015-11-02T13:18:41 *** tawar has joined #bitcoin-dev
463 2015-11-02T13:19:04 *** frank1e has joined #bitcoin-dev
464 2015-11-02T13:20:29 *** Starsocceraway is now known as starsoccer
465 2015-11-02T13:20:59 *** ThomasV has quit IRC
466 2015-11-02T13:21:04 *** antizionist__ has joined #bitcoin-dev
467 2015-11-02T13:21:22 *** rnvk has joined #bitcoin-dev
468 2015-11-02T13:22:44 *** adam3us has joined #bitcoin-dev
469 2015-11-02T13:22:44 *** davec has quit IRC
470 2015-11-02T13:22:54 *** tawar has quit IRC
471 2015-11-02T13:23:28 *** davec has joined #bitcoin-dev
472 2015-11-02T13:34:01 *** IAmNotDorian has quit IRC
473 2015-11-02T13:35:31 *** tawar has joined #bitcoin-dev
474 2015-11-02T13:43:10 *** h3xc0d3r has quit IRC
475 2015-11-02T13:50:37 *** h3xc0d3r has joined #bitcoin-dev
476 2015-11-02T13:53:35 *** CheckDavid has quit IRC
477 2015-11-02T13:56:25 *** n0n0_ has quit IRC
478 2015-11-02T13:58:00 *** agricocb has quit IRC
479 2015-11-02T14:02:24 *** tantalum has joined #bitcoin-dev
480 2015-11-02T14:08:09 *** treehug8_ has joined #bitcoin-dev
481 2015-11-02T14:08:12 *** hashtag_ has joined #bitcoin-dev
482 2015-11-02T14:08:35 *** ivan\ has quit IRC
483 2015-11-02T14:08:52 *** nessence has quit IRC
484 2015-11-02T14:09:01 *** InternetFriend has joined #bitcoin-dev
485 2015-11-02T14:09:07 *** benrcole has joined #bitcoin-dev
486 2015-11-02T14:10:06 *** Guest73396 has joined #bitcoin-dev
487 2015-11-02T14:10:59 *** Guest83587 has quit IRC
488 2015-11-02T14:11:07 *** asyn has joined #bitcoin-dev
489 2015-11-02T14:16:43 *** ivan\ has joined #bitcoin-dev
490 2015-11-02T14:17:10 *** b_ has joined #bitcoin-dev
491 2015-11-02T14:17:14 *** xantik has quit IRC
492 2015-11-02T14:18:29 *** agricocb has joined #bitcoin-dev
493 2015-11-02T14:18:34 *** agricocb has quit IRC
494 2015-11-02T14:18:35 *** agricocb has joined #bitcoin-dev
495 2015-11-02T14:18:46 *** Ahmed90 has joined #bitcoin-dev
496 2015-11-02T14:19:07 *** AMERICAN_PSYCHO has quit IRC
497 2015-11-02T14:19:27 *** agricocb has quit IRC
498 2015-11-02T14:19:30 *** asyn has left #bitcoin-dev
499 2015-11-02T14:19:35 *** agricocb has joined #bitcoin-dev
500 2015-11-02T14:22:06 *** afk11 has quit IRC
501 2015-11-02T14:23:02 *** Internet13 has quit IRC
502 2015-11-02T14:24:09 *** afk11 has joined #bitcoin-dev
503 2015-11-02T14:26:20 *** Internet13 has joined #bitcoin-dev
504 2015-11-02T14:27:52 *** p15x has quit IRC
505 2015-11-02T14:30:51 <mcelrath> No one had any comments on my proposal to validate (level)DB correctness using UTXO set commitment hashes? Good/bad/indifferent? Would this help us get a db implementation out of the core or e.g. @gmaxwell do you think it would still be required?
506 2015-11-02T14:31:55 *** roxtrongo has joined #bitcoin-dev
507 2015-11-02T14:32:05 <mcelrath> FWIW this kind of computation can be used to validate correctness, whether or not the hashes are broadcast in blocks.
508 2015-11-02T14:32:06 <sipa> mcelrath: we already have gettxoutsetinfo which reports such a hash
509 2015-11-02T14:32:09 *** afk11 has quit IRC
510 2015-11-02T14:32:46 *** afk11 has joined #bitcoin-dev
511 2015-11-02T14:33:06 <sipa> and i don't think it matters... it's an extra warning layer, but not a replacement for avoiding unnecessary risk
512 2015-11-02T14:34:27 <mcelrath> Oh interesting, didn't know about gettxoutsetinfo...
513 2015-11-02T14:35:00 <sipa> it is not usable as a commitment scheme because it's horribly slow
514 2015-11-02T14:35:23 <sipa> but it can (and has) been used to identify corruptio
515 2015-11-02T14:35:31 <mcelrath> So given multiple pluggable db backends with acceptable performance, what will happen? Will we allow user selection at ./configure time? Will we switch from leveldb and import an entire db codebase into the core?
516 2015-11-02T14:36:08 <sipa> i consider multiple pluggable db backends to be unnecessary risk
517 2015-11-02T14:36:11 *** roxtrongo has quit IRC
518 2015-11-02T14:36:21 <wumpus> unless there is overwhelming evidence that some other database works better, we'll just stick with leveldb
519 2015-11-02T14:36:28 <sipa> unless there is not one database that can perform adequately
520 2015-11-02T14:37:18 *** metalcamp has quit IRC
521 2015-11-02T14:37:25 <mcelrath> I was thinking LMDB which runs in 64-bit only mode with some speed advantage, and another db for the raspberry pi users...
522 2015-11-02T14:37:30 <mcelrath> (for instance)
523 2015-11-02T14:37:41 <wumpus> have you profiled lmdb with bitcoin?
524 2015-11-02T14:38:08 <mcelrath> I'm considering throwing some time at that this week. But I don't want to waste my time if everyone is going to put the kibosh on the idea.
525 2015-11-02T14:38:09 <wumpus> if not, please don't make statements, bitcoind's use pattern is kind of different from the average micro benchmark
526 2015-11-02T14:39:08 <sipa> if it turns out to be unreasonably much faster, i think it is something worth considering (but LMDB has other downaides too, like no checksums)
527 2015-11-02T14:39:10 <wumpus> well if you do it do it as an experiment, not with the expectation that it will be merged any time soon. It's nice to be able to compare databases.
528 2015-11-02T14:39:37 *** roxtrongo has joined #bitcoin-dev
529 2015-11-02T14:39:38 <mcelrath> Of course it's an experiment.
530 2015-11-02T14:39:54 <mcelrath> Not having db corruption so often is reason enough to proceed with the experiment.
531 2015-11-02T14:40:28 <sipa> i have never ever (as in: at all) seen leveldb corrupt on a system of mine, and i reindex a lot
532 2015-11-02T14:40:34 <wumpus> are you having db corruption often?
533 2015-11-02T14:40:57 <sipa> i've done tests that include ripping the power on a running system
534 2015-11-02T14:40:58 <wumpus> I have had corruption but it always turned out to be due to faulty hardware
535 2015-11-02T14:41:25 <wumpus> if you are having problems on windows help test: https://github.com/bitcoin/bitcoin/pull/6917
536 2015-11-02T14:41:25 <sipa> the only time i have seen corruption is when i wrote a script that replaced radom bytes in the middle of db files
537 2015-11-02T14:41:35 <jgarzik> I've never had leveldb corruption that I could successfully blame on leveldb
538 2015-11-02T14:41:40 <mcelrath> I have had corruption that I was able to trace to faulty hardware. I've had other corruption that I wasn't able to identify the source. And windows users complain a lot about corruption from what I've seen.
539 2015-11-02T14:41:52 <jgarzik> Never at home, and occasionally on a cheap VPS where VPS is most likely culprit
540 2015-11-02T14:41:55 <wumpus> mcelrath: if you are a windows user, please test https://github.com/bitcoin/bitcoin/pull/6917
541 2015-11-02T14:42:07 <wumpus> (executables can be found in that thread, too)
542 2015-11-02T14:42:12 <mcelrath> Nice
543 2015-11-02T14:42:28 *** agricocb has quit IRC
544 2015-11-02T14:43:01 <jgarzik> After that one leveldb version fix upstream, most corruption reports externally seem to be faulty hardware
545 2015-11-02T14:43:21 <wumpus> yes, either faulty hardware or windows-and-pulled the plug
546 2015-11-02T14:43:56 <mcelrath> I'm actually pretty concerned about faulty hardware and adding methods to the core that can separate faulty hardware from blockchain forks, and inform the operator.
547 2015-11-02T14:43:58 <wumpus> of which the second problem should be solved by #6917, haven't managed to cause any leveldb corruption on a crash after that
548 2015-11-02T14:44:13 <mcelrath> wumpus: that's awesome
549 2015-11-02T14:44:15 <wumpus> mcelrath: that's exactly what leveldb does now - it detects the corruption and tells the user
550 2015-11-02T14:44:25 <wumpus> lmdb wouldn't, for example.
551 2015-11-02T14:44:41 <wumpus> leveldb checks CRCs on *everything*
552 2015-11-02T14:44:50 <mcelrath> That's a very nice feature.
553 2015-11-02T14:44:52 <wumpus> (at least in the way we use it)
554 2015-11-02T14:45:06 <wumpus> really, leveldb is good software
555 2015-11-02T14:45:16 <mcelrath> But CRC checks could be added for any db by the caller.
556 2015-11-02T14:45:20 <wumpus> you have to be really good to beat it
557 2015-11-02T14:45:27 <mcelrath> wumpus: that doesn't seem to be the balance of opinion about leveldb ;-)
558 2015-11-02T14:45:47 <wumpus> mcelrath: it's the base of many other databases and sw used in production at companies
559 2015-11-02T14:46:55 <wumpus> unless you did research in databases and completely understand the implementations and implications, I'm not really interested in balance of opinions
560 2015-11-02T14:46:55 <mcelrath> So the second complaint everyone makes about leveldb is that it's unmaintained. What's your opinion on that? (is it a problem)
561 2015-11-02T14:47:29 <wumpus> is that a problem?
562 2015-11-02T14:47:29 *** starsoccer has quit IRC
563 2015-11-02T14:47:43 <mcelrath> yes
564 2015-11-02T14:47:56 <wumpus> depends on whether we can fix issues as they come up
565 2015-11-02T14:48:01 <wumpus> a sample size of one says: yes
566 2015-11-02T14:52:32 *** ThomasV has joined #bitcoin-dev
567 2015-11-02T14:52:56 *** Alina-malina has quit IRC
568 2015-11-02T14:52:59 *** starsoccer has joined #bitcoin-dev
569 2015-11-02T14:53:00 *** starsoccer has joined #bitcoin-dev
570 2015-11-02T14:53:32 *** wraithm has joined #bitcoin-dev
571 2015-11-02T14:53:35 <wumpus> again, if you have overwhelming evidence that another specific database, which is better maintained, works better in our load patterns that would be great, switching databases at some point in the future for a good reason is open - I'm not wedded to leveldb. But if not I don't see the point of even discussing it...
572 2015-11-02T14:53:36 *** tawar has quit IRC
573 2015-11-02T14:53:36 <sipa> i have to admit i got into an unreasonable "leveldb is terrible, we must go find a replacement" mentality myself, and started assuming some unicorn database would actually exist that solves all our problemd
574 2015-11-02T14:54:07 *** metalcamp has joined #bitcoin-dev
575 2015-11-02T14:54:30 <jgarzik> RE maintenance: It is a problem in theory. In reality, last time we had a Really Big problem, we banged a drum and the maintainers were willing to help with a fix.
576 2015-11-02T14:54:47 <sipa> time is better spent on actually solving issues that pop up - something we are certainly capable of to some extent
577 2015-11-02T14:55:00 <sipa> and yes, we can keep looking for replacements
578 2015-11-02T14:55:42 <jgarzik> It stands at the level of technical debt, not pressing need: A better replacement, or a better maintained replacement, is in general preferred -- with all the "meeting a high bar" requirements that come with any replacement.
579 2015-11-02T14:55:43 <mcelrath> sipa: hash_serialized iterates over the entire leveldb. No wonder it's slow. My proposal would keep a running tally and would be a lot faster. e.g. hash(utxo set) ~= hash(all txo's) - hash(spent txo's)
580 2015-11-02T14:56:27 <sipa> how is that faster?
581 2015-11-02T14:56:39 <mcelrath> It's updated with each block ingest.
582 2015-11-02T14:56:52 <mcelrath> From the previous block hashes
583 2015-11-02T14:57:13 <sipa> how would it detect database corruption?
584 2015-11-02T14:57:32 <mcelrath> You compute it twice, once on block ingest by looking at the block, and once by querying the db.
585 2015-11-02T14:57:57 <sipa> that doesn't answer my question :)
586 2015-11-02T14:58:09 <mcelrath> If the db hash is different from the ingest hash, the db has fucked up ;-)
587 2015-11-02T14:58:44 <sipa> if you don't recompute it from the data actually in thebdatabase, how will it detect corruption?
588 2015-11-02T14:59:10 *** IAmNotDorian has joined #bitcoin-dev
589 2015-11-02T14:59:11 <mcelrath> You have to use the database to detect corruption in the database... I'm not sure what you're getting at...
590 2015-11-02T14:59:44 *** damethos has quit IRC
591 2015-11-02T14:59:48 <mcelrath> There's a way to compute this *without* the database, which differentiates it from hash_serialized.
592 2015-11-02T15:00:01 * jgarzik needs to rig a hook to log leveldb API traffic, so that it can be replayed on replacement db solutions
593 2015-11-02T15:00:41 *** damethos has joined #bitcoin-dev
594 2015-11-02T15:00:50 <sipa> mcelrath: ok i see what you're saying
595 2015-11-02T15:01:29 <sipa> it doesn't speed up corruption detection, but it does offer a faster incremental way to compute it without the database
596 2015-11-02T15:02:09 <sipa> how is the hash(set) operation implemented?
597 2015-11-02T15:02:16 <mcelrath> I need to understand how hash_serialized detects corruption. But I agree with the second part.
598 2015-11-02T15:02:59 <jgarzik> That's interesting. A dbm that automatically provides a stable hash for its state.
599 2015-11-02T15:03:13 <mcelrath> I think I described it well enough on the mailing list, but I can rehash it here.
600 2015-11-02T15:03:32 <sipa> mcelrath: i'm not on the mailing list, but i can read a link
601 2015-11-02T15:03:35 <mcelrath> On block ingest compute the hash of all txo's and seperately any spent txo's in that block. So there are two.
602 2015-11-02T15:04:01 <mcelrath> http://lists.linuxfoundation.org/pipermail/bitcoin-dev/2015-October/011638.html
603 2015-11-02T15:05:08 <sipa> that requires ordering
604 2015-11-02T15:05:16 <mcelrath> Yes. Blocks specify the ordering.
605 2015-11-02T15:05:21 <sipa> the utxo set does not maintain ordering
606 2015-11-02T15:05:32 <sipa> so you can't recompute it from the utxo set
607 2015-11-02T15:05:45 <sipa> it also doesn't contain spent entries
608 2015-11-02T15:05:51 *** alferz has joined #bitcoin-dev
609 2015-11-02T15:06:19 *** kadoban has joined #bitcoin-dev
610 2015-11-02T15:06:58 <mcelrath> When I'm ingesting a block, I query the db for a UTXO that gets spent in that block. So it is in the db before I'm done ingesting the block.
611 2015-11-02T15:07:00 *** btc_panhandler has joined #bitcoin-dev
612 2015-11-02T15:07:39 <sipa> you're explaining how to compute a hash of all txouts created and one for all txouts spent; i'm with you that far
613 2015-11-02T15:08:08 <sipa> but there is no way to recompute it from just the utxo set, so how would it provide a mechanism to prove that a particular utxo set is correct?
614 2015-11-02T15:08:23 <sipa> except by giving all blocks in history
615 2015-11-02T15:09:11 *** tawar has joined #bitcoin-dev
616 2015-11-02T15:10:35 *** h3xc0d3r has quit IRC
617 2015-11-02T15:10:40 <mcelrath> There is no way to compute it from just the UTXO set, true. One has to iterate over past blocks (to determine ordering) and the check is done per-block. So really, you're validating the (u|s)txo's involved in that block only, not the entire db.
618 2015-11-02T15:10:57 <sipa> ok
619 2015-11-02T15:11:56 <mcelrath> Validating the entire db at once is of course a more comprehensive test of the db. But costly.
620 2015-11-02T15:13:16 <sipa> the solution i like most so far is to compute the utxo hash by implicitly building a merkle tree of utxo entries and computing its root hash every 2016 blocks or so, and then committing to it 2016 blocks later
621 2015-11-02T15:14:00 *** Palsson has quit IRC
622 2015-11-02T15:14:02 <sipa> that doesn't need a fully tree-structured database with all intermediate hashes stored like a merkle-structured database
623 2015-11-02T15:14:36 <mcelrath> Yeah I've seen that discussion, mostly in the context of proving utxo's for thin wallets. My proposal is a faster compromise that isn't really useful for thin wallets.
624 2015-11-02T15:15:05 <mcelrath> e.g. bramc's "Merkle Set"
625 2015-11-02T15:15:30 <mcelrath> Also requires ordering...
626 2015-11-02T15:15:43 <sipa> there are different use cases
627 2015-11-02T15:15:50 <mcelrath> Yes, different use cases.
628 2015-11-02T15:16:22 <mcelrath> But the latter implies the former. If we had Merkle UTXO commitments we wouldn't need what I'm proposing, they're equivalent.
629 2015-11-02T15:16:23 <sipa> the one i care about most is being to give someone a utxo set, and prove that the blockchain contains a commitment to it, validatable without actually seeing the full block chain
630 2015-11-02T15:16:34 <sipa> yours doesn't provide that
631 2015-11-02T15:16:35 *** xMopxShell has joined #bitcoin-dev
632 2015-11-02T15:16:37 *** blazeme8 has joined #bitcoin-dev
633 2015-11-02T15:17:11 <mcelrath> Nope.
634 2015-11-02T15:17:14 <sipa> that is doable without any merkle structure
635 2015-11-02T15:17:26 <mcelrath> But extremely computationally intensive.
636 2015-11-02T15:17:36 *** alferz has quit IRC
637 2015-11-02T15:17:39 <sipa> not more than the current serialized_hash
638 2015-11-02T15:17:53 <mcelrath> True.
639 2015-11-02T15:18:10 *** tawar_ has joined #bitcoin-dev
640 2015-11-02T15:18:10 *** sinetek has joined #bitcoin-dev
641 2015-11-02T15:18:14 *** tawar_ has quit IRC
642 2015-11-02T15:18:17 <sipa> but yes, not something you want inside the block validation path
643 2015-11-02T15:19:06 <sipa> you need merkle structure for two things: conpact proofs, and fast update
644 2015-11-02T15:19:39 <sipa> the former only needs an implicit merkle structure (we could implement it today with the current database)
645 2015-11-02T15:19:44 <mcelrath> So what we need is a faster way to compute the Merkle-ized UTXO commitment, or a compromise. I'm proposing a compromise that accomplishes some goals, but I'd love to see a proposal for a faster commitment computatoin.
646 2015-11-02T15:19:50 *** lnostdal__ is now known as lnostdal
647 2015-11-02T15:20:21 <sipa> the latter needs an explicit merkle structured databasez with a merkle-structured rollbackable cache, ...
648 2015-11-02T15:20:45 <sipa> to make it efficient enough, and even then, it probably is an order of magnitude more I/o
649 2015-11-02T15:20:49 <mcelrath> Does that exist?
650 2015-11-02T15:21:05 <sipa> people have been implementing those for years
651 2015-11-02T15:21:11 <sipa> not inside bitcoin core
652 2015-11-02T15:21:19 <sipa> but these are well-researched ideas
653 2015-11-02T15:21:38 <mcelrath> Can you point to some links?
654 2015-11-02T15:21:57 <mcelrath> If I'm going to fool with replacing leveldb, I'd rather try with a Merkle-ized implementation!
655 2015-11-02T15:22:18 <jgarzik> mcelrath, please keep me in the loop. I'm already writing an implementation..
656 2015-11-02T15:22:25 <sipa> i wouldn't even replace leveldb; it can be done on top of any database
657 2015-11-02T15:22:32 <mcelrath> jgarzik: I know. Will do.
658 2015-11-02T15:22:42 <sipa> but no matter what, i expect it to require an order of magnitude more I/O
659 2015-11-02T15:22:56 <sipa> which i doubt is acceptable overhead currebtly
660 2015-11-02T15:23:07 <mcelrath> Every write requires updating a Merkle branch, so yes, I see an order of magnitude there.
661 2015-11-02T15:23:29 <jgarzik> mcelrath, sipa, my current effort is already a COW database, which makes a few things easier on the recompute-hash side
662 2015-11-02T15:23:53 <sipa> you can't do this at the database layer
663 2015-11-02T15:23:59 <jgarzik> depends on how you structure the tree and tree updates...
664 2015-11-02T15:24:04 <sipa> as the hash would be over semantic data
665 2015-11-02T15:24:13 <jgarzik> don't necessarily have to go for the naive merkle approach
666 2015-11-02T15:24:40 <sipa> (you don't want bitcoin's consensus rules to depend on the db backend you chose, right?)
667 2015-11-02T15:26:43 <mcelrath> @jgarzik you're writing a Merkle-db implementation? Or are you talking about your sqlite branch?
668 2015-11-02T15:26:56 *** DougieBot5000 has joined #bitcoin-dev
669 2015-11-02T15:26:57 *** Arnavion has quit IRC
670 2015-11-02T15:27:01 *** Arnavion3 has joined #bitcoin-dev
671 2015-11-02T15:27:05 *** Arnavion3 is now known as Arnavion
672 2015-11-02T15:27:13 *** sanada` has joined #bitcoin-dev
673 2015-11-02T15:27:19 *** optimator_ has joined #bitcoin-dev
674 2015-11-02T15:28:51 *** malte- has joined #bitcoin-dev
675 2015-11-02T15:29:19 <jgarzik> mcelrath, 1) pgdb2 will have a merkle db option, yes, 2) no, not talking about sqlite. sqlite is an experiment that's reach an endpoint IMO.
676 2015-11-02T15:30:26 *** b__ has joined #bitcoin-dev
677 2015-11-02T15:30:28 *** anarchystar_ has joined #bitcoin-dev
678 2015-11-02T15:30:32 *** pfalleno1 has joined #bitcoin-dev
679 2015-11-02T15:30:35 *** pierre`_ has joined #bitcoin-dev
680 2015-11-02T15:30:39 *** wump has joined #bitcoin-dev
681 2015-11-02T15:30:46 *** damethos has quit IRC
682 2015-11-02T15:30:53 *** darvon_ has joined #bitcoin-dev
683 2015-11-02T15:30:55 *** hasha_ has joined #bitcoin-dev
684 2015-11-02T15:31:06 *** cdecker_ has joined #bitcoin-dev
685 2015-11-02T15:32:03 *** Graet has quit IRC
686 2015-11-02T15:33:07 <mcelrath> Neat! I'm willing to help.
687 2015-11-02T15:33:32 *** agricocb has joined #bitcoin-dev
688 2015-11-02T15:33:35 *** agricocb has joined #bitcoin-dev
689 2015-11-02T15:33:59 *** CodeShark has quit IRC
690 2015-11-02T15:34:26 *** Graet has joined #bitcoin-dev
691 2015-11-02T15:35:19 *** tawar has quit IRC
692 2015-11-02T15:35:19 *** b_ has quit IRC
693 2015-11-02T15:35:19 *** nodee3333 has quit IRC
694 2015-11-02T15:35:20 *** epopt has quit IRC
695 2015-11-02T15:35:20 *** Soligor has quit IRC
696 2015-11-02T15:35:20 *** JackH has quit IRC
697 2015-11-02T15:35:21 *** sipa has quit IRC
698 2015-11-02T15:35:21 *** hanti has quit IRC
699 2015-11-02T15:35:21 *** _flow_ has quit IRC
700 2015-11-02T15:35:21 *** pfallenop has quit IRC
701 2015-11-02T15:35:21 *** null_radix has quit IRC
702 2015-11-02T15:35:22 *** Qatz has quit IRC
703 2015-11-02T15:35:22 *** anarchystar has quit IRC
704 2015-11-02T15:35:22 *** iinaj has quit IRC
705 2015-11-02T15:35:23 *** cdecker has quit IRC
706 2015-11-02T15:35:23 *** dstien has quit IRC
707 2015-11-02T15:35:23 *** pierre` has quit IRC
708 2015-11-02T15:35:23 *** malte has quit IRC
709 2015-11-02T15:35:24 *** hno` has quit IRC
710 2015-11-02T15:35:24 *** wumpus has quit IRC
711 2015-11-02T15:35:25 *** sanada has quit IRC
712 2015-11-02T15:35:25 *** thrasher` has quit IRC
713 2015-11-02T15:35:25 *** guruvan has quit IRC
714 2015-11-02T15:35:25 *** darvon has quit IRC
715 2015-11-02T15:35:26 *** BlueMatt has quit IRC
716 2015-11-02T15:35:26 *** ibrightly has quit IRC
717 2015-11-02T15:35:26 *** mission712 has quit IRC
718 2015-11-02T15:35:27 *** hasha has quit IRC
719 2015-11-02T15:35:27 *** jlyndon has quit IRC
720 2015-11-02T15:35:27 *** thurmyt3 has quit IRC
721 2015-11-02T15:35:27 *** optimator has quit IRC
722 2015-11-02T15:36:12 *** arichnad has joined #bitcoin-dev
723 2015-11-02T15:36:22 *** thurmyt3 has joined #bitcoin-dev
724 2015-11-02T15:37:27 *** thrasher` has joined #bitcoin-dev
725 2015-11-02T15:37:27 *** guruvan has joined #bitcoin-dev
726 2015-11-02T15:37:31 *** jlyndon has joined #bitcoin-dev
727 2015-11-02T15:37:56 *** BlueMatt has joined #bitcoin-dev
728 2015-11-02T15:38:31 *** nodee3333 has joined #bitcoin-dev
729 2015-11-02T15:38:41 *** anarchystar_ is now known as anarchystar
730 2015-11-02T15:38:46 <jgarzik> mcelrath, pgdb2 is a refresh of some earlier kernel filesystem designs of mine. page-based copy-on-write transactional lower layer + (not yet written) higher multi-table key/value db with hash stability
731 2015-11-02T15:39:29 <jgarzik> the hope is that it is flexible enough for merkle db also, but I need more background info on use cases
732 2015-11-02T15:39:58 <mcelrath> Why not pull the hash tree out from the db and keep it separately?
733 2015-11-02T15:40:18 <jgarzik> mcelrath, that's easily doable with this layered design
734 2015-11-02T15:40:56 *** nskelsey has quit IRC
735 2015-11-02T15:41:07 *** nskelsey has joined #bitcoin-dev
736 2015-11-02T15:41:18 <jgarzik> paged file < COW inodes [multi-page runs, map-able together] < database layers
737 2015-11-02T15:41:36 *** JackH has joined #bitcoin-dev
738 2015-11-02T15:41:44 *** kgk has joined #bitcoin-dev
739 2015-11-02T15:41:45 <mcelrath> Which kernel filesystems did you work on?
740 2015-11-02T15:42:12 *** Soligor has joined #bitcoin-dev
741 2015-11-02T15:42:36 <jgarzik> core Linux VFS, ext4, and stuff of my own design. a little bit on btrfs
742 2015-11-02T15:42:59 <jgarzik> little bits here and there in unimportant filesystems like hpfs ;p
743 2015-11-02T15:43:32 *** h3xc0d3r has joined #bitcoin-dev
744 2015-11-02T15:43:39 <mcelrath> Neat. A fascination of mine but I've never actually worked on a fs. I run btrfs on all my systems. ;-) COW is the only way to go.
745 2015-11-02T15:43:53 *** zooko has joined #bitcoin-dev
746 2015-11-02T15:43:53 *** swappermall has quit IRC
747 2015-11-02T15:43:54 *** tawar has joined #bitcoin-dev
748 2015-11-02T15:44:08 <jgarzik> COW is actually friendly to modern flash-based devices, which perform wear levelling anyway
749 2015-11-02T15:44:33 *** h3xc0d3r has quit IRC
750 2015-11-02T15:44:58 <jgarzik> mcelrath, has anyone theorized what a C/C++ merkle db api might look like?
751 2015-11-02T15:45:05 *** h3xc0d3r has joined #bitcoin-dev
752 2015-11-02T15:45:25 * jgarzik is still building up the knowledge base
753 2015-11-02T15:45:46 * mcelrath is doing some googling.
754 2015-11-02T15:46:20 <mcelrath> I'd think it would be identical to a key-value store, with two extra methods: getroot and getbranch(key) to get the Merkle branch.
755 2015-11-02T15:46:30 *** kgk has quit IRC
756 2015-11-02T15:47:01 <mcelrath> Insert and delete would have to be modified to update the tree all the way back to the root. That concerns me, It's a lot more I/O.
757 2015-11-02T15:50:15 <jgarzik> mcelrath, there's a lot of hidden i/o in COW anyway, since a data update potentially updates the list of where data is stored (extent list), which potentially updates inode, which potentially updates superblock.
758 2015-11-02T15:50:34 <jgarzik> mcelrath, just make sure to stream the i/o together all at once.
759 2015-11-02T15:51:05 <mcelrath> That had occurred to me. btrfs must be updating the superblock with every write.
760 2015-11-02T15:51:11 <jgarzik> COW trades off additional i/o for less double-writing of a journal
761 2015-11-02T15:51:43 <jgarzik> (arguably COW replaces it with more-than-double-writing, but for modern SSDs who cares)
762 2015-11-02T15:52:29 <jgarzik> mcelrath, That's why I think a COW is very friendly to hash-stable apps
763 2015-11-02T15:52:48 <jgarzik> it's also nicely lock-free in many paths
764 2015-11-02T15:52:57 <mcelrath> Bundling all IO for an update of a large tree seems hard. You need the root node and a leaf node in the same block.
765 2015-11-02T15:53:28 <mcelrath> That makes the tree inefficiently stored for traversal of any other path.
766 2015-11-02T15:53:29 <jgarzik> mcelrath, not at all. just need to write(2) them at the same time
767 2015-11-02T15:53:54 <mcelrath> In any case, it seems any update involves multiple writes.
768 2015-11-02T15:53:55 <jgarzik> mcelrath, modern OS and, underneath, modern storage handle scatter/gather just fine
769 2015-11-02T15:53:59 *** mission712 has joined #bitcoin-dev
770 2015-11-02T15:54:57 <mcelrath> We need bramc on this conversation. I want some details on his Merkle Set. ;-)
771 2015-11-02T15:55:04 *** IAmNotDorian has quit IRC
772 2015-11-02T15:56:16 <jgarzik> mcelrath, yes and no. to over-simplify, on modern OS, the kernel bundles all writes in various locations of the file together into one bundle, to send to storage, between fsync() calls.
773 2015-11-02T15:56:19 *** n0n0_ has joined #bitcoin-dev
774 2015-11-02T15:56:49 <jgarzik> mcelrath, multiple writes get aggregated at several levels.
775 2015-11-02T15:57:20 *** noamh has quit IRC
776 2015-11-02T15:57:43 <jgarzik> mcelrath, one key issue is seek time. if you use SSD, then reading and writing "all over the place" is just fine, as seek time is basically zero. if you use a rotational hard drive, seek time plays a role.
777 2015-11-02T15:58:08 <Diablo-D3> re: ssd
778 2015-11-02T15:58:14 <Diablo-D3> THIS is why I use ssd
779 2015-11-02T15:58:16 <jgarzik> mcelrath, for this merkle db application, (1) many writes + (2) recommend SSD
780 2015-11-02T15:58:34 <Diablo-D3> because db apps love to write several things concurrently that would drive a hdd into the ground via seeks
781 2015-11-02T15:58:40 <Diablo-D3> and db apps also love to read those back
782 2015-11-02T15:59:08 <Diablo-D3> and SSDs can complete o_fsync ops a shitload faster
783 2015-11-02T15:59:17 <Diablo-D3> [10:51:11] <jgarzik> COW trades off additional i/o for less double-writing of a journal
784 2015-11-02T15:59:21 <Diablo-D3> jgarzik: thats not entirely true
785 2015-11-02T15:59:34 <jgarzik> Diablo-D3, read the next line
786 2015-11-02T15:59:49 <Diablo-D3> [10:51:43] <jgarzik> (arguably COW replaces it with more-than-double-writing, but for modern SSDs who cares)
787 2015-11-02T15:59:50 <Diablo-D3> that?
788 2015-11-02T15:59:54 <Diablo-D3> depends on how COW is impl
789 2015-11-02T16:00:08 <jgarzik> yes
790 2015-11-02T16:00:14 <Diablo-D3> if you're doing a dumb write log that eventually gets baked into a canonical db
791 2015-11-02T16:00:16 <Diablo-D3> yeah its double writes
792 2015-11-02T16:00:36 <Diablo-D3> if you're just storing previous known working copies, its double storage but not necessarily double writes
793 2015-11-02T16:00:48 <Diablo-D3> though it depends on the scale of your data objects
794 2015-11-02T16:01:13 <Diablo-D3> if your db rows are tiny and you update very few at a time, yeah, the size of your data update is going to be the size of your journal update
795 2015-11-02T16:01:21 <Diablo-D3> ergo, double writing
796 2015-11-02T16:01:26 <Diablo-D3> BUT writes aren't even fatal
797 2015-11-02T16:01:30 *** patcon has quit IRC
798 2015-11-02T16:01:33 <Diablo-D3> modern ssds do hundreds of TB before they die
799 2015-11-02T16:01:51 <Diablo-D3> like, crucial m500, m550, and mx200 (aka m600 dc but for consumers)?
800 2015-11-02T16:01:56 <Diablo-D3> all claim shit like 72TB
801 2015-11-02T16:02:02 <Diablo-D3> thats their _warranty_ value
802 2015-11-02T16:02:12 <Diablo-D3> they last at least 4x that.
803 2015-11-02T16:02:47 <mcelrath> jgarzik: There's a collection of literature on "incremental hash functions" that I wonder might be useful for this. I considered it for my post about UTXO commitments, but I realized it wasn't necessary, that idea can be done with standard hash functions.
804 2015-11-02T16:02:58 <afk11> Since people are researching DB schemes, I'm writing an SQL database to hold the data a full node would. I've been having some fun with nested sets - it implicitly lets you write simple queries for hierarchical chains, tips, etc.
805 2015-11-02T16:03:01 <Diablo-D3> 72TB works out to something like 3 years of an extremely artificial case of 24/7 writing and never reading
806 2015-11-02T16:03:20 <Diablo-D3> like, not even reading to check that your write succeeded properly
807 2015-11-02T16:03:26 <Diablo-D3> not even doing fs journaling
808 2015-11-02T16:03:40 <Diablo-D3> its extremely hard to kill a properly functioning good ssd these days
809 2015-11-02T16:03:49 *** Alina-malina has joined #bitcoin-dev
810 2015-11-02T16:04:01 <Diablo-D3> _plus_ now that pci-e 3.0 x2 interfaces over sata express are becoming the norm
811 2015-11-02T16:05:05 <Diablo-D3> doing >150k 4k write iops on highly randomized patterns on low queue depths (>1 but <=half (usually 32 on pre nvme drives)) is becoming the norm..
812 2015-11-02T16:05:36 <Diablo-D3> its like, you have the db write performance of what used to be one goddamned huge server, now in a single drive
813 2015-11-02T16:05:39 *** lnostdal has quit IRC
814 2015-11-02T16:06:51 *** ibrightly has joined #bitcoin-dev
815 2015-11-02T16:07:12 *** sipa has joined #bitcoin-dev
816 2015-11-02T16:07:37 *** iinaj has joined #bitcoin-dev
817 2015-11-02T16:07:46 *** hanti has joined #bitcoin-dev
818 2015-11-02T16:07:47 *** hanti has joined #bitcoin-dev
819 2015-11-02T16:08:10 <mcelrath> afk11: Can you elaborate on nested set queries? Any links?
820 2015-11-02T16:08:45 *** null_radix has joined #bitcoin-dev
821 2015-11-02T16:09:21 *** Qatz has joined #bitcoin-dev
822 2015-11-02T16:09:38 *** bitcoin-dev480 has joined #bitcoin-dev
823 2015-11-02T16:10:05 <bitcoin-dev480> How can I calulcate miners fees when constructing raw transactions?
824 2015-11-02T16:10:26 *** porquilho has joined #bitcoin-dev
825 2015-11-02T16:11:51 *** c0rw1n has quit IRC
826 2015-11-02T16:12:13 *** c0rw1n has joined #bitcoin-dev
827 2015-11-02T16:13:00 *** Graet has quit IRC
828 2015-11-02T16:13:51 *** hno has joined #bitcoin-dev
829 2015-11-02T16:14:30 *** Graet has joined #bitcoin-dev
830 2015-11-02T16:15:38 *** dstien has joined #bitcoin-dev
831 2015-11-02T16:16:32 <bitcoin-dev480> anyone?
832 2015-11-02T16:18:42 *** lnostdal has joined #bitcoin-dev
833 2015-11-02T16:20:17 *** noamh has joined #bitcoin-dev
834 2015-11-02T16:22:37 *** noamh has joined #bitcoin-dev
835 2015-11-02T16:23:11 *** StormDev has quit IRC
836 2015-11-02T16:23:37 *** noamh has joined #bitcoin-dev
837 2015-11-02T16:26:45 <afk11> mcelrath: http://mikehillyer.com/articles/managing-hierarchical-data-in-mysql/ explains adjacency set first, then nested sets.
838 2015-11-02T16:28:48 <afk11> so, instead of maintaining a table that contains your 'best chain', you keep them all in one and query for tips.
839 2015-11-02T16:29:00 *** btc_panhandler has quit IRC
840 2015-11-02T16:29:18 *** tombtc has joined #bitcoin-dev
841 2015-11-02T16:29:26 *** ThomasKeller has quit IRC
842 2015-11-02T16:29:31 *** btc_panhandler has joined #bitcoin-dev
843 2015-11-02T16:29:34 *** tombtc has left #bitcoin-dev
844 2015-11-02T16:29:54 *** Guest73396 has quit IRC
845 2015-11-02T16:30:22 <afk11> UTXO set is handled the same way. Store them all, and join against the chain of blocks up to a 'tip' you specify.
846 2015-11-02T16:33:44 *** zooko has quit IRC
847 2015-11-02T16:34:12 *** zooko has joined #bitcoin-dev
848 2015-11-02T16:40:18 *** Dizzle has joined #bitcoin-dev
849 2015-11-02T16:49:11 *** spinza has quit IRC
850 2015-11-02T16:49:12 *** btc_panhandler_ has joined #bitcoin-dev
851 2015-11-02T16:50:21 *** btc_panhandler has quit IRC
852 2015-11-02T16:50:21 *** btc_panhandler_ is now known as btc_panhandler
853 2015-11-02T16:52:34 *** spinza has joined #bitcoin-dev
854 2015-11-02T16:56:44 *** _yoy_ has joined #bitcoin-dev
855 2015-11-02T16:58:32 <sipa> afk11: your performance will be horrible if you store all utxo sets
856 2015-11-02T16:59:03 *** Emzy has joined #bitcoin-dev
857 2015-11-02T17:00:03 *** c-cex-yuriy has joined #bitcoin-dev
858 2015-11-02T17:00:12 *** blazeme8 has quit IRC
859 2015-11-02T17:00:44 *** Iriez has quit IRC
860 2015-11-02T17:01:27 *** ThomasKeller has joined #bitcoin-dev
861 2015-11-02T17:01:45 *** patcon has joined #bitcoin-dev
862 2015-11-02T17:02:37 *** AaronvanW has quit IRC
863 2015-11-02T17:04:08 *** Dizzle__ has joined #bitcoin-dev
864 2015-11-02T17:04:17 *** blazeme8 has joined #bitcoin-dev
865 2015-11-02T17:04:38 *** Dizzle has quit IRC
866 2015-11-02T17:04:41 *** Dizzle__ is now known as Dizzle
867 2015-11-02T17:07:26 *** coin_trader has joined #bitcoin-dev
868 2015-11-02T17:08:51 *** benrcole has quit IRC
869 2015-11-02T17:09:19 *** blazeme8 has quit IRC
870 2015-11-02T17:11:00 *** neozaru has joined #bitcoin-dev
871 2015-11-02T17:11:29 <mcelrath> I think he's discovering that ;-)
872 2015-11-02T17:11:39 *** noamh has quit IRC
873 2015-11-02T17:11:45 *** xolokram has quit IRC
874 2015-11-02T17:11:57 *** rnvk has quit IRC
875 2015-11-02T17:12:15 *** blazeme8 has joined #bitcoin-dev
876 2015-11-02T17:12:15 *** lewellyn has quit IRC
877 2015-11-02T17:12:38 *** roxtrongo has quit IRC
878 2015-11-02T17:12:54 *** blazeme8 has quit IRC
879 2015-11-02T17:13:46 *** blazeme8 has joined #bitcoin-dev
880 2015-11-02T17:16:54 *** Grouver has quit IRC
881 2015-11-02T17:17:01 <gmaxwell> 06:45 < mcelrath> But CRC checks could be added for any db by the caller.
882 2015-11-02T17:17:02 *** romonster has quit IRC
883 2015-11-02T17:17:19 *** blazeme8 has joined #bitcoin-dev
884 2015-11-02T17:17:24 <gmaxwell> not so, ... how do you CRC a key not found error (except via an expensive reimplementation of the database)
885 2015-11-02T17:17:28 <gmaxwell> ?
886 2015-11-02T17:17:29 *** BashCo has quit IRC
887 2015-11-02T17:18:34 <gmaxwell> Part of the reason there are corruption reports is because of the super extensive checking, both in leveldb itself, and at the application level... but as was said above, AFAICT the corruption reports we have are limited to these windows specific ones where we know the cause.
888 2015-11-02T17:18:51 *** missmogg has quit IRC
889 2015-11-02T17:19:08 <gmaxwell> On linux I left a system for a month on a remote power switch that hard cut the power then let it start back up and cut it again... and never corrupted.
890 2015-11-02T17:19:22 *** romonster has joined #bitcoin-dev
891 2015-11-02T17:20:08 <gmaxwell> Not a guarentee of course, but pretty good.
892 2015-11-02T17:22:16 *** lewellyn has joined #bitcoin-dev
893 2015-11-02T17:22:42 *** missmogg has joined #bitcoin-dev
894 2015-11-02T17:23:42 *** lewellyn has quit IRC
895 2015-11-02T17:24:46 *** brson has joined #bitcoin-dev
896 2015-11-02T17:25:27 *** rdymac has joined #bitcoin-dev
897 2015-11-02T17:25:56 *** h3xc0d3r has quit IRC
898 2015-11-02T17:25:59 *** romonster has quit IRC
899 2015-11-02T17:26:06 *** zooko has quit IRC
900 2015-11-02T17:26:14 *** Squidicuz has joined #bitcoin-dev
901 2015-11-02T17:26:42 *** ThomasV has quit IRC
902 2015-11-02T17:26:46 *** Squidicc has quit IRC
903 2015-11-02T17:27:12 *** melvster has quit IRC
904 2015-11-02T17:28:19 *** Madars has quit IRC
905 2015-11-02T17:29:05 *** missmogg has quit IRC
906 2015-11-02T17:29:19 *** mission712 has quit IRC
907 2015-11-02T17:29:40 *** Madars has joined #bitcoin-dev
908 2015-11-02T17:30:13 *** blazeme8 has quit IRC
909 2015-11-02T17:31:02 *** xMopxShell has quit IRC
910 2015-11-02T17:32:17 *** blazeme8 has joined #bitcoin-dev
911 2015-11-02T17:32:24 *** xMopxShell has joined #bitcoin-dev
912 2015-11-02T17:34:08 *** deepcore has joined #bitcoin-dev
913 2015-11-02T17:34:23 *** zooko has joined #bitcoin-dev
914 2015-11-02T17:35:50 *** AaronvanW has joined #bitcoin-dev
915 2015-11-02T17:39:11 *** xMopxShell has quit IRC
916 2015-11-02T17:39:49 *** melvster has joined #bitcoin-dev
917 2015-11-02T17:43:38 *** Guest47571 has joined #bitcoin-dev
918 2015-11-02T17:43:39 *** kgk has joined #bitcoin-dev
919 2015-11-02T17:46:48 *** PaulCape_ has quit IRC
920 2015-11-02T17:48:06 *** kgk has quit IRC
921 2015-11-02T17:48:10 *** h3xc0d3r has joined #bitcoin-dev
922 2015-11-02T17:48:27 *** PaulCapestany has joined #bitcoin-dev
923 2015-11-02T17:49:51 *** xMopxShell has joined #bitcoin-dev
924 2015-11-02T17:50:20 *** bitcoin-dev480 has quit IRC
925 2015-11-02T17:51:57 *** xMopxShell has quit IRC
926 2015-11-02T17:52:11 *** romonster has joined #bitcoin-dev
927 2015-11-02T17:53:14 *** afk11 has quit IRC
928 2015-11-02T17:53:17 *** Grouver has joined #bitcoin-dev
929 2015-11-02T17:53:25 *** splix has quit IRC
930 2015-11-02T17:53:26 *** lewellyn has joined #bitcoin-dev
931 2015-11-02T17:54:51 *** xMopxShell has joined #bitcoin-dev
932 2015-11-02T17:56:31 *** Beef has quit IRC
933 2015-11-02T17:56:49 *** romonster has quit IRC
934 2015-11-02T17:57:46 *** sinetek has quit IRC
935 2015-11-02T17:58:10 *** lewellyn has quit IRC
936 2015-11-02T18:00:59 *** Beef has joined #bitcoin-dev
937 2015-11-02T18:01:34 *** BashCo has joined #bitcoin-dev
938 2015-11-02T18:01:49 *** sinetek has joined #bitcoin-dev
939 2015-11-02T18:01:49 *** roidster has joined #bitcoin-dev
940 2015-11-02T18:01:53 *** Lightsword has joined #bitcoin-dev
941 2015-11-02T18:03:56 *** tawar has quit IRC
942 2015-11-02T18:04:51 <mcelrath> Point taken.
943 2015-11-02T18:05:09 <mcelrath> We've had linux corruption too. If I can prove it's not flaky hardware, I'll report it.
944 2015-11-02T18:06:44 <gmaxwell> yea, not impossible. Unfortunately "flaky hardware" is super common. I think on linux I'm reasonably confident that flaky hardware is much more likely than a problem with leveldb.
945 2015-11-02T18:07:15 <gmaxwell> Also, errors can be in the filesystem or in the disk firmware too.
946 2015-11-02T18:07:33 *** romonster has joined #bitcoin-dev
947 2015-11-02T18:08:44 *** n0n0_ has quit IRC
948 2015-11-02T18:09:37 *** benrcole has joined #bitcoin-dev
949 2015-11-02T18:10:39 <mcelrath> A bit longer term I'd really like to identify pathways prone to corruption, and trigger a re-evaluation of the computation that led to corruption. This problem will only get worse.
950 2015-11-02T18:14:06 <sipa> re-evaluation may mean reindexing the blockchain from scratch, as the data the computation is based on may not be avilable anymore
951 2015-11-02T18:14:17 *** missmogg has joined #bitcoin-dev
952 2015-11-02T18:14:19 *** lewellyn has joined #bitcoin-dev
953 2015-11-02T18:14:46 <mcelrath> I'd like to find some happy medium that requires anything less than a full reindex...
954 2015-11-02T18:16:43 <sipa> etafeel free to think about that :)
955 2015-11-02T18:16:52 <sipa> *feel free
956 2015-11-02T18:17:46 *** Iriez has joined #bitcoin-dev
957 2015-11-02T18:21:19 *** tawar has joined #bitcoin-dev
958 2015-11-02T18:25:35 *** benrcole has quit IRC
959 2015-11-02T18:26:24 <gmaxwell> mcelrath: I believe the leveldb error checking is technically overly agressive, in that it's possible for there to be perfectly recoverable errors that it refuses to continue on. Even if there is a "recovery" it can be hard to be absolutely sure you haven't silently loss something, and so we think it's better to suffer a reindex.
960 2015-11-02T18:26:32 <gmaxwell> Also, reindexs are currently artifically slow.
961 2015-11-02T18:27:04 *** roxtrongo has joined #bitcoin-dev
962 2015-11-02T18:29:27 <mcelrath> Yeah one would need to really prove the recovery was correct. What keeps reindex slow?
963 2015-11-02T18:31:16 <sipa> due to a bug it revalidates historical signatures
964 2015-11-02T18:34:35 *** paveljanik has joined #bitcoin-dev
965 2015-11-02T18:34:35 *** paveljanik has quit IRC
966 2015-11-02T18:34:35 *** paveljanik has joined #bitcoin-dev
967 2015-11-02T18:35:56 <Luke-Jr> mcelrath: I thought I had Linux corruption too, but when I went to make a sample db for wumpus to look at, the system stopped working entirely, so.. :/
968 2015-11-02T18:36:28 * Luke-Jr should probably try another microSD card
969 2015-11-02T18:40:59 *** SwedFTP has quit IRC
970 2015-11-02T18:42:28 *** justanotheruser has quit IRC
971 2015-11-02T18:42:57 * mcelrath is now killing bitcoin in a loop. We'll see.
972 2015-11-02T18:44:46 *** lewellyn has quit IRC
973 2015-11-02T18:47:05 *** btc_panhandler has quit IRC
974 2015-11-02T18:49:55 *** btc_panhandler has joined #bitcoin-dev
975 2015-11-02T18:51:26 *** romonster has quit IRC
976 2015-11-02T18:53:10 *** nickler has quit IRC
977 2015-11-02T18:54:23 *** SwedFTP has joined #bitcoin-dev
978 2015-11-02T18:54:32 *** bitcoin-dev415 has joined #bitcoin-dev
979 2015-11-02T18:54:34 *** missmogg has quit IRC
980 2015-11-02T18:55:20 *** tcrypt has joined #bitcoin-dev
981 2015-11-02T18:55:24 *** roxtrongo has quit IRC
982 2015-11-02T18:56:37 *** roxtrongo has joined #bitcoin-dev
983 2015-11-02T18:57:00 *** rlifchitz has quit IRC
984 2015-11-02T18:58:38 <bitcoin-dev415> Does bitcoin-core consider unconfirmed change as "available" balance?
985 2015-11-02T18:59:14 *** justanotheruser has joined #bitcoin-dev
986 2015-11-02T19:00:12 <mcelrath> Unconformed change is no different than any other kind of transaction output. If it's unconfirmed, it's unconfirmed. A new transaction to spend it is valid.
987 2015-11-02T19:01:07 <bitcoin-dev415> but it does not show up when using "listunpsent"?
988 2015-11-02T19:01:22 *** wraithm has quit IRC
989 2015-11-02T19:01:39 *** wraithm has joined #bitcoin-dev
990 2015-11-02T19:02:07 <bitcoin-dev415> or I have to specify for 0 confirmations? is that really safe to use in a new transaction?
991 2015-11-02T19:04:22 <bitcoin-dev415> what happens if the previous transaction gets modified by transaction malleability?
992 2015-11-02T19:05:32 <mcelrath> It's not safe. listunspent takes two parameters minconf, maxconf which set the minimum and maximum confirmations to filter.
993 2015-11-02T19:05:41 <mcelrath> BTW this probably belongs in #bitcoin
994 2015-11-02T19:05:55 <Luke-Jr> mcelrath: I don't think you can corrupt it by killing Bitcoin Core..
995 2015-11-02T19:06:14 <mcelrath> Luke-Jr: I don't think so either. But it's worth a try. ;-)
996 2015-11-02T19:08:23 <gmaxwell> mcelrath: thats not correct
997 2015-11-02T19:08:55 *** rusty has joined #bitcoin-dev
998 2015-11-02T19:11:19 <gmaxwell> mcelrath: by default bitcoin core will spend its own unconfirmed change, but only if it has no other choice.
999 2015-11-02T19:11:21 *** romonster has joined #bitcoin-dev
1000 2015-11-02T19:11:45 <gmaxwell> This can be disabled with a config option.
1001 2015-11-02T19:12:51 <mcelrath> Thanks gmaxwell. bitcoin-dev415 the option is -spendzeroconfchange
1002 2015-11-02T19:13:43 <bitcoin-dev415> Thanks, I will try that!
1003 2015-11-02T19:16:53 *** nullbyte has joined #bitcoin-dev
1004 2015-11-02T19:17:10 *** romonster has quit IRC
1005 2015-11-02T19:18:22 *** forge_ has joined #bitcoin-dev
1006 2015-11-02T19:18:49 *** Unit has joined #bitcoin-dev
1007 2015-11-02T19:19:01 <bitcoin-dev415> mcelrath: just what I needed, thank you!
1008 2015-11-02T19:27:22 *** padxni has joined #bitcoin-dev
1009 2015-11-02T19:28:02 *** hashtag has quit IRC
1010 2015-11-02T19:28:09 *** hashtag_ has quit IRC
1011 2015-11-02T19:28:35 *** hashtag has joined #bitcoin-dev
1012 2015-11-02T19:28:36 *** hashtag_ has joined #bitcoin-dev
1013 2015-11-02T19:29:24 *** lewellyn has joined #bitcoin-dev
1014 2015-11-02T19:29:46 *** romonster has joined #bitcoin-dev
1015 2015-11-02T19:31:17 *** zooko has quit IRC
1016 2015-11-02T19:34:18 *** lewellyn has quit IRC
1017 2015-11-02T19:36:24 *** romonster has quit IRC
1018 2015-11-02T19:37:57 *** matsjj has quit IRC
1019 2015-11-02T19:38:37 *** nickler has joined #bitcoin-dev
1020 2015-11-02T19:38:44 *** missmogg has joined #bitcoin-dev
1021 2015-11-02T19:38:52 *** IngCr3at1on has joined #bitcoin-dev
1022 2015-11-02T19:42:35 *** roxtrongo has quit IRC
1023 2015-11-02T19:44:59 *** kgk has joined #bitcoin-dev
1024 2015-11-02T19:45:23 *** romonster has joined #bitcoin-dev
1025 2015-11-02T19:45:35 *** lewellyn has joined #bitcoin-dev
1026 2015-11-02T19:46:46 *** lnovy has joined #bitcoin-dev
1027 2015-11-02T19:48:24 *** moli has joined #bitcoin-dev
1028 2015-11-02T19:49:31 *** kgk has quit IRC
1029 2015-11-02T19:50:39 *** molly has quit IRC
1030 2015-11-02T19:53:18 *** bitkarma has joined #bitcoin-dev
1031 2015-11-02T19:53:30 *** phoenix54 has joined #bitcoin-dev
1032 2015-11-02T19:55:53 *** Burrito has joined #bitcoin-dev
1033 2015-11-02T19:57:11 *** SwedFTP has quit IRC
1034 2015-11-02T19:59:43 *** AaronvanW has quit IRC
1035 2015-11-02T20:03:40 *** SwedFTP has joined #bitcoin-dev
1036 2015-11-02T20:06:34 *** roxtrongo has joined #bitcoin-dev
1037 2015-11-02T20:10:36 *** nowan has quit IRC
1038 2015-11-02T20:10:36 *** rnvk has joined #bitcoin-dev
1039 2015-11-02T20:15:23 *** forge_ has quit IRC
1040 2015-11-02T20:15:44 *** nowan has joined #bitcoin-dev
1041 2015-11-02T20:16:46 *** nowan has quit IRC
1042 2015-11-02T20:17:48 *** btc_panhandler has quit IRC
1043 2015-11-02T20:19:45 *** nowan has joined #bitcoin-dev
1044 2015-11-02T20:23:48 *** CoinMuncher has quit IRC
1045 2015-11-02T20:29:10 *** brson has quit IRC
1046 2015-11-02T20:30:41 *** belcher has joined #bitcoin-dev
1047 2015-11-02T20:32:50 *** Alina-malina has quit IRC
1048 2015-11-02T20:36:23 *** tcrypt has quit IRC
1049 2015-11-02T20:36:57 *** Alina-malina has joined #bitcoin-dev
1050 2015-11-02T20:37:00 *** CheckDavid has joined #bitcoin-dev
1051 2015-11-02T20:41:01 *** patcon has quit IRC
1052 2015-11-02T20:41:50 *** Alina-malina has quit IRC
1053 2015-11-02T20:42:10 *** AaronvanW has joined #bitcoin-dev
1054 2015-11-02T20:45:31 *** paveljanik has quit IRC
1055 2015-11-02T20:52:33 *** matsjj has joined #bitcoin-dev
1056 2015-11-02T20:54:54 *** Palsson has joined #bitcoin-dev
1057 2015-11-02T20:56:54 *** Grouver has quit IRC
1058 2015-11-02T21:03:06 *** Palsson has quit IRC
1059 2015-11-02T21:08:10 *** ratbanebo has joined #bitcoin-dev
1060 2015-11-02T21:09:23 *** btc_panhandler has joined #bitcoin-dev
1061 2015-11-02T21:09:49 *** meLon has quit IRC
1062 2015-11-02T21:10:09 *** meLon has joined #bitcoin-dev
1063 2015-11-02T21:11:57 *** rodkeys has joined #bitcoin-dev
1064 2015-11-02T21:12:34 *** brson has joined #bitcoin-dev
1065 2015-11-02T21:14:56 *** Alina-malina has joined #bitcoin-dev
1066 2015-11-02T21:24:45 *** btc_panhandler has quit IRC
1067 2015-11-02T21:26:35 *** phoenix54 has quit IRC
1068 2015-11-02T21:27:02 *** wraithm has quit IRC
1069 2015-11-02T21:31:59 *** Alina-malina has quit IRC
1070 2015-11-02T21:33:49 <morcos> andybody know if there are duplicate coinbases on testnet3?
1071 2015-11-02T21:34:34 *** lewellyn has quit IRC
1072 2015-11-02T21:34:35 <morcos> i'm wondering if its safe to skip BIP30 check there after BIP34 activation, but depends on whether there is still the potential to create duplicate transactions
1073 2015-11-02T21:35:25 <jgarzik> morcos, well you get down to the probability of hash collision ...
1074 2015-11-02T21:35:37 <jgarzik> never zero but "atoms in the universe" small
1075 2015-11-02T21:36:22 <jgarzik> morcos, the by-accident consensus rule is that the later duplicate "overwrites" the visibility of the prior transaction
1076 2015-11-02T21:36:24 <morcos> jgarzik: yes, but if duplicate coinbases were created before BIP34 and unlike on the main chain, the first was spent before the second overwrote it, then there is still the possiblity to create overwriting txs
1077 2015-11-02T21:36:30 *** btc_panhandler has joined #bitcoin-dev
1078 2015-11-02T21:36:45 <morcos> jgarzik: after BIP30 the rule is you are not allowed to overwrite
1079 2015-11-02T21:36:51 *** missmogg has quit IRC
1080 2015-11-02T21:36:59 *** btc_panhandler has quit IRC
1081 2015-11-02T21:37:23 *** nickler has quit IRC
1082 2015-11-02T21:37:46 <morcos> i'm going to disable enforcing BIP30 on the main chain after BIP34 activation, and want to know if I can do the same on testnet
1083 2015-11-02T21:37:56 <jgarzik> morcos, nod - though operationally you have people making coding software that makes assumptions based on uniqueness of hash
1084 2015-11-02T21:38:10 <jgarzik> so IMO in effect the problem still remains [to a very small extent]
1085 2015-11-02T21:38:30 *** roidster is now known as zzyzx
1086 2015-11-02T21:39:11 *** zzyzx is now known as ZZyZX
1087 2015-11-02T21:49:20 *** ParadoxSpiral has quit IRC
1088 2015-11-02T21:50:58 *** besharam has joined #bitcoin-dev
1089 2015-11-02T21:51:25 *** lewellyn has joined #bitcoin-dev
1090 2015-11-02T21:54:09 *** treehug8_ has quit IRC
1091 2015-11-02T21:54:51 *** tcrypt has joined #bitcoin-dev
1092 2015-11-02T21:55:16 *** nullbyte has quit IRC
1093 2015-11-02T21:57:24 *** romonster has quit IRC
1094 2015-11-02T21:57:28 *** neozaru has quit IRC
1095 2015-11-02T21:58:14 *** frank1e is now known as Floridafrank1e
1096 2015-11-02T22:00:56 *** matsjj has quit IRC
1097 2015-11-02T22:02:15 *** roxtrong_ has joined #bitcoin-dev
1098 2015-11-02T22:03:10 *** rusty has quit IRC
1099 2015-11-02T22:04:51 *** roxtrongo has quit IRC
1100 2015-11-02T22:05:58 *** InternetFriend has quit IRC
1101 2015-11-02T22:06:34 *** exeq has joined #bitcoin-dev
1102 2015-11-02T22:09:32 *** zooko has joined #bitcoin-dev
1103 2015-11-02T22:10:08 *** romonster has joined #bitcoin-dev
1104 2015-11-02T22:13:10 *** zooko` has joined #bitcoin-dev
1105 2015-11-02T22:14:35 *** romonster has quit IRC
1106 2015-11-02T22:14:51 *** snthsnth has joined #bitcoin-dev
1107 2015-11-02T22:15:15 *** zooko has quit IRC
1108 2015-11-02T22:18:32 *** SwedFTP has quit IRC
1109 2015-11-02T22:18:45 *** btc_panhandler has joined #bitcoin-dev
1110 2015-11-02T22:19:10 *** treehug88 has quit IRC
1111 2015-11-02T22:19:56 *** SwedFTP has joined #bitcoin-dev
1112 2015-11-02T22:20:33 *** lewellyn has joined #bitcoin-dev
1113 2015-11-02T22:23:58 *** romonster has joined #bitcoin-dev
1114 2015-11-02T22:25:20 *** iv3c has joined #bitcoin-dev
1115 2015-11-02T22:25:44 *** lewellyn has quit IRC
1116 2015-11-02T22:30:27 *** nickler has joined #bitcoin-dev
1117 2015-11-02T22:30:39 *** ZZyZX has quit IRC
1118 2015-11-02T22:31:16 *** AaronvanW has quit IRC
1119 2015-11-02T22:31:20 *** tantalum has quit IRC
1120 2015-11-02T22:32:11 *** AaronvanW has joined #bitcoin-dev
1121 2015-11-02T22:32:30 *** metal_camp has joined #bitcoin-dev
1122 2015-11-02T22:32:33 *** brson_ has joined #bitcoin-dev
1123 2015-11-02T22:32:41 *** AaronvanW has quit IRC
1124 2015-11-02T22:33:30 *** brson_ has quit IRC
1125 2015-11-02T22:33:38 *** brson_ has joined #bitcoin-dev
1126 2015-11-02T22:33:47 *** brson has quit IRC
1127 2015-11-02T22:35:36 *** won9 has joined #bitcoin-dev
1128 2015-11-02T22:36:02 *** metalcamp has quit IRC
1129 2015-11-02T22:36:06 *** lewellyn has joined #bitcoin-dev
1130 2015-11-02T22:36:12 *** AaronvanW has joined #bitcoin-dev
1131 2015-11-02T22:36:12 *** AaronvanW has quit IRC
1132 2015-11-02T22:36:12 *** AaronvanW has joined #bitcoin-dev
1133 2015-11-02T22:36:26 *** CodeShark has joined #bitcoin-dev
1134 2015-11-02T22:36:44 *** missmogg has joined #bitcoin-dev
1135 2015-11-02T22:38:13 *** zooko` is now known as zooko
1136 2015-11-02T22:38:33 *** AaronvanW has quit IRC
1137 2015-11-02T22:41:11 *** AaronvanW has joined #bitcoin-dev
1138 2015-11-02T22:41:11 *** AaronvanW has joined #bitcoin-dev
1139 2015-11-02T22:41:22 *** AaronvanW has quit IRC
1140 2015-11-02T22:45:52 *** AaronvanW has joined #bitcoin-dev
1141 2015-11-02T22:45:52 *** AaronvanW has quit IRC
1142 2015-11-02T22:45:52 *** AaronvanW has joined #bitcoin-dev
1143 2015-11-02T22:46:04 *** mcelrath has quit IRC
1144 2015-11-02T22:46:20 *** AaronvanW has quit IRC
1145 2015-11-02T22:53:29 *** roxtrong_ has quit IRC
1146 2015-11-02T22:53:35 *** iv3c has quit IRC
1147 2015-11-02T22:55:57 *** roxtrongo has joined #bitcoin-dev
1148 2015-11-02T22:57:06 *** metal_camp has quit IRC
1149 2015-11-02T23:01:41 *** tawar has quit IRC
1150 2015-11-02T23:01:42 *** Palsson has joined #bitcoin-dev
1151 2015-11-02T23:01:59 *** complexring has quit IRC
1152 2015-11-02T23:02:33 *** afk11 has joined #bitcoin-dev
1153 2015-11-02T23:03:33 *** koad has quit IRC
1154 2015-11-02T23:03:46 *** snthsnth has quit IRC
1155 2015-11-02T23:04:06 *** cryptapus_ has joined #bitcoin-dev
1156 2015-11-02T23:05:24 *** AaronvanW has joined #bitcoin-dev
1157 2015-11-02T23:05:24 *** AaronvanW has quit IRC
1158 2015-11-02T23:05:24 *** AaronvanW has joined #bitcoin-dev
1159 2015-11-02T23:05:59 *** complexring has joined #bitcoin-dev
1160 2015-11-02T23:06:40 *** afk11 has quit IRC
1161 2015-11-02T23:07:00 *** afk11 has joined #bitcoin-dev
1162 2015-11-02T23:07:15 *** romonster has quit IRC
1163 2015-11-02T23:08:22 *** jtimon has quit IRC
1164 2015-11-02T23:08:26 *** justanotheruser has quit IRC
1165 2015-11-02T23:08:48 *** cryptapus_ has quit IRC
1166 2015-11-02T23:12:25 *** lewellyn has quit IRC
1167 2015-11-02T23:12:29 *** crescendo has joined #bitcoin-dev
1168 2015-11-02T23:18:26 *** nickler has quit IRC
1169 2015-11-02T23:20:11 *** justanotheruser has joined #bitcoin-dev
1170 2015-11-02T23:26:55 *** AaronvanW has quit IRC
1171 2015-11-02T23:29:36 *** romonster has joined #bitcoin-dev
1172 2015-11-02T23:31:10 *** missmogg has quit IRC
1173 2015-11-02T23:39:06 *** sinetek has quit IRC
1174 2015-11-02T23:40:18 *** romonster has quit IRC
1175 2015-11-02T23:40:29 *** sinetek has joined #bitcoin-dev
1176 2015-11-02T23:41:26 *** deepcore has quit IRC
1177 2015-11-02T23:42:21 *** Tebbo has joined #bitcoin-dev
1178 2015-11-02T23:43:35 *** CheckDavid has quit IRC
1179 2015-11-02T23:44:59 *** btc_panhandler has quit IRC
1180 2015-11-02T23:45:45 *** supasonic has joined #bitcoin-dev
1181 2015-11-02T23:46:49 *** kgk has joined #bitcoin-dev
1182 2015-11-02T23:46:57 *** Ahmed90 has quit IRC
1183 2015-11-02T23:48:06 *** owowo has quit IRC
1184 2015-11-02T23:48:35 *** nickler has joined #bitcoin-dev
1185 2015-11-02T23:49:01 *** btc_panhandler has joined #bitcoin-dev
1186 2015-11-02T23:51:19 *** kgk has quit IRC
1187 2015-11-02T23:52:13 *** romonster has joined #bitcoin-dev
1188 2015-11-02T23:53:24 *** rusty has joined #bitcoin-dev
1189 2015-11-02T23:54:06 *** owowo has joined #bitcoin-dev
1190 2015-11-02T23:58:03 *** DougieBot5000 has quit IRC
1191 2015-11-02T23:59:03 <zooko> If anybody is, or knows how to communicate with, Jan Carlsson, could you have Jan contact me? zooko@LeastAuthority.com .
1192 2015-11-02T23:59:14 *** Emzy has quit IRC