It's relevant in the sense that my analogy clearly demonstrates that cherry picking data sets allows one to make about any claim under the sun with respect to a "candidate signal" and the concept of "statistical noise" can be misleading. In LIGO's case their statistical noise is devoid of most of the more likely environmental influences that could cause that signal, so their sigma calculation cannot be used to eliminate environmental influences.Higgsy wrote: I have no idea what you're talking about here. I am not party to whatever discussion you are referring to and in any case I see no relevance to our discussion here.
In this case then, where's the "discovery" if it's not related to cause?You see the thing that really puzzles me Michael is all this fuss you are making here (and on other forums apparently) about how the sigma of the detection doesn't relate to cause, and when I point out to you that it doesn't relate to cause, it can't relate to cause and no-one expects it to relate to cause, you start saying it's useless.If the sigma isn't related to the cause in any physical way, it's just a useless math exercise in the final analysis. LIGO started by *stripping out* the most likely environmental causes of the signal and cherry picked only the data they wished to "compare" their candidate signal to. They "eliminated" statistical (cherry picked) background influences, but they couldn't possibly eliminate *all* environmental influences that way.
It depends on the specific situation. If we're talking about particle physics "discoveries", the mere presence of something that cannot be generated by (non cherry-picked) statistical noise might actually constitute a "discovery". In this case there was a cherry-picking process up front, and the "statistical noise" therefore means almost nothing with respect to eliminating other potential "causes" of this "chirp" signal.The reason I'm puzzled is that determining the probability of whether an apparent signal is signal or random noise is completely routine, not just here but in every branch of physics. I'm amazed that someone like you who takes such an interest in physics doesn't know that. I don't understand why this is at all controversial.
In terms of removing "photon pressure noise" from consideration, that's fine. In terms of removing *all environmental noise*, it's a useless figure.You measure the statistics of your static random noise (arising from shot noise in the electronics, photon pressure noise and so on) and you determine the probability that that static random background could give rise to the thing you think is a signal, and you express that probability as a sigma.
You really should look my "aliens did it" analogy. It clearly demonstrates the danger of cherry picking the data set.(Oh and by the way, in determining the statistics of the random static noise, you have to do so at a time when the system is quiet and not subject to transients, whether true signal or transient noise. See below)
Well, I already capitulated to Selfsim with respect to using that sigma to eliminate various *internal* (to the equipment itself) potential influences, but it no way can it be used to eliminate any *external* causes from consideration. It's actually "questionable" even in terms of internal noise because of the blatant cherry picking problem. LIGO only selected their "best case" data set, not the full data set. It's still a cherry picked data set with respect to various internal influences too.(There is also continuous noise associated with specific sources such as mains and its harmonics, resonances in the mirror suspension systems and so on which you can notch filter out of the data since these are tones).
Why are they even comparing this signal to a "clean" data set in the first place if you're trying to eliminate environmental contamination from being the cause of the signal? Keep in mind that this exact signal was first *vetoed* by the software which was in place at the time of the signal. This also brings up the blatant confirmation bias problem inherent in LIGO's methodology. All other potential influences are said to be 'eliminated' from further consideration based upon a lack of an observed signal in some type of *external* equipment or measurement, whereas all celestial origin claims are simply given a free pass without respect to any elimination process at all. There's not even a potential category for "unknown cause". Why? How can that even be considered a "scientific" methodology if the method favors all celestial origin claims and disfavors all other potential causes of the same signal?Now let's say that, as in this case, the probability that the putative signal could arise from the static random background noise is very low - the statistics of the backround noise compared with the putative signal indicates that the signal would only arise from the random noise once in 100,000 odd years. OK, so you have a signal, but you're not out of the woods yet. You still have to eliminate the possibility that your signal is caused by either intrumental or environmental transients - earthquakes, lightning strikes, heavy trucks moving about near the experiment, North Korean nuclear tests, doors slamming in the office, blip transients etc etc. In this case LIGO has a large number of channels with accelerometers and magnetometers and seismometers and microphones and so on and so forth to eliminate envirionmental transients. Once you have done all that, and the environment is clean and the kit is running clean, you can at last say that you have a proper signal.
Since they had *just* completed a major upgrade of this equipment, and they were only in the engineering run of this new configuration, how could they even know for sure that ordinary "blip transients" are *never* detected by both detectors, or that that they *never* "chirp" (change frequency)? These two "human decisions" look to be highly questionable choices considering that this equipment was much more sensitive than previous versions, and they had not even completed the engineering run. They could have just as easily have "assumed" that blip transients can sometimes be observed in their new equipment, and they can sometimes "chirp" (change frequency). That seems like a purely *arbitrary choice* that was specifically intended to skew the results, just like the cherry picking, and just like the confirmation bias of having no exclusion method for celestial claims.But you're still not out of the woods, because the next question is did the other site see the same signal, and what was the coherence between them? If you do time slides of the data from the two sites does a slide within a few milliseconds give a big response? If only one site sees it, throw it away. If both sites see something but the time difference is too great, throw them away. In this case you have a very strong signal which has a high degree of coherence with a physical time difference between the two sites. You're still not out of the woods, because you have to match the signal you now have with merger templates, and if, and only if, your coherent signal appearing at both sites matches a template for inspiral, merger and ring-down, then you think you might have a candidate.
I'm exercised by it for three main reasons. They blatantly and intentionally *cherry picked* the data set, they didn't use the whole set of data. They also have no way to exclude environmental data this way. They have no way to exclude blip transients this way either without making two *questionable assumptions* about them which could not possibly be known at the time of the signal.But the main point is that LIGO is using sigma estimates in a completely routine, normal and boring way, and I am surprised that you are exercised by it.
In addition to those three problems, they have a *huge* problem with confirmation bias because their methodology favors all celestial origin claims, and disfavors all other potential causes of candidate signals. Without a visual/neutrino confirmation requirement, there is simply no way to be sure where this signal came from.
Nobody outside of LIGO even knows why that veto was added or what specific type of "environmental' influence is was trying to detect. We don't know why it rejected this exact signal with a 'high confidence' figure. We don't know what the term 'safe" even means in any quantified way. Maybe it did 'safely' remove the exact environmental factor that LIGO was originally trying to filtered out with this veto. Why specifically was that veto even added inAs I understand it the veto has been explained - it came from an uncalibrated strain channel that should have been labelled unsafe, but wasn't, and was manually labelled unsafe afterwards.
the first place? What was it designed to do?
Except that's exactly what they did with respect to claiming to have eliminated environmental noise from consideration. Frankly I'm also *appalled* that they gave a whitewashed account of veto events. I've never seen such a thing before.I'm not sure you understand what vetoes are and what they are for. Vetoes are not intended to dictate conclusions.
Why *specifically* was that veto written in the first place, and what was it trying to remove so it didn't drive folks mad? Why did it achieve a "high confidence" figure in the first place, and how "safe" was it to simply override that veto? How 'safe' is safe? 80 percent safe? 90 percent safe? 5.1 sigma safe? How does anyone know that it didn't correctly veto out exactly what it was designed to filter out in the first place?They are an aid, not a supervisor. The data is noisy, with high levels of static and transient noise. Multiple channels look at the strain data in multiple ways and trigger potential candidates - dozens per day. Everyone would go mad if they had to analyse all those candidates, so automatic vetoes are used to say "ignore this, it's probably noise; ignore this, it's not a big enough signal; ignore this, it's the wrong shape". Nothing says that people can't over-ride a veto, if on analysis they disagree with it. But in this case there wasn't even a valid veto in the first place as it came from an uncalibrated strain channel, that should not have been allowed a veto in the first place. There was no valid veto (by the way, it wasn't measuring the environment - it was a strain channel).
The confirmation bias comes in when there's no elimination method applied to celestial origin claims as there is for any and all other claims of origin. They eliminated ground movement and EM field influences from consideration based upon a *lack* of confirmation in some other external equipment. They looked and looked and looked for evidence to support a celestial event and they didn't find one. In fact, they haven't found one in any of the three events that they claim are related to celestial events! How likely is it that they'd really be 0 for 3 if these really were celestial in origin?And it brings me back to the point that you know what you're looking for and when you see it, it's not unreasonable to say so. I fail to see where the confirmation bias is.That only brings us right back to their blatant confirmation bias problem. They eliminated *non-celestial* claims based uponi a *lack* of external corroboration in external hardware. They then blatantly *failed* to put their own celestial claims through that very same process of elimination. They simply rigged the system in their favor.
The only way you can even try to build such a case is to begin with a special pleading fallacy. We couldn't see them because......
They're 0 for 3, and according to the Nature article, they have 6 more "candidate signals" and I've not heard a single peep about *any* of them enjoying a single shred of visual support. What confidence can I possibly have in such a claim? You've claiming that two entirely invisible entities emitted multiple solar masses of energy in a quarter of second, but they magically did so without emitting enough EM emissions to be seen from Earth. Doesn't that sound even the least bit suspicious to you? Even if black holes themselves to not emit light, the plasma around the black hole tends to be brighter than any other plasma in space. That last claim even suggested something about "spin" angles not matching which would likely result in *massive* interactions of the accretion disks. If they happen to be charged, you could end up with discharges taking place inside the accretion disks too.If you're talking about counterparts, it's always been considered that seeing a counterpart of a neutron star merger would be great physics, but no-one ever said as part of the LIGO experimental design that seeing a counterpart is needed to claim a detection - and in fact no counterpart or a very difficult to detect counterpart is expected from a BH merger.
They had over 40 days of data to work with but they only selected 16 of the "cleanest" days they could get their hands on, presumably to get the highest sigma possible.I really don't know what you mean by cherry picking. What data was cherry picked?This isn't like particle physics discovery where *any* type of deviation from the standard model is a "discovery" of something new. Particle physicists also don't "cherry pick" their data.
They didn't eliminate environmental causes with that sigma!The detection of gravitational waves caused by a black hole merger as inferred from the fit between the data and the theory and the elimination of all other likely causes,Then where's the "discovery" in this paper?
It also "detects" all sorts of stuff that has nothing to do with gravitational waves.using an instrument designed to detect gravitational waves.
Very well? This is where the quantified aspects look to be far less "quantified" than one might hope, particularly if we're claiming "discovery".Well, it's a strong signal, and it's compared with the best fit neutron star/BH merger template, which it doesn't fit very well (too short on the inspiral side, no ring down),See figure 12:
http://iopscience.iop.org/article/10.10 ... 34001/meta
https://arxiv.org/abs/1602.03844
They even mention that this blip transient event fits with a neutron star/black hole merger pattern.
But how can we know that that something like a long distance electrical discharge *between* the two detectors, or rare power grid problems, or whistler wave from high in the atmosphere might not influence both detectors at once? Both detectors just got a *major* upgrade that made them 10 times more sensitive than ever before in terms of distance, and a 1000 times more sensitive in terms of volume space.and of course it only appears at one site.
Except that exactly not what they claimed.There is no frequency evolution and it doesn't match a BH merger. So, no, blip transients don't match the candidates at all.
That depends *entirely* as to whether you include the 3 in question (print) and the 6 other ones they claim to be reviewing into the category of "blip transient", or you claim they are "gravitational waves". It's a purely human decision to make that distinction, and ultimately it's still an "act of faith" in the absence of any corroboration from any satellite in space or on the ground.And if I had bread I could make a sandwich if I had some cheese. No blip transients have ever been detected that match an inspiral, merger and ring down signal in both detectors at a physical delay, and especially not a BH merger signal.Since they're in the engineering run to test the capability of their heavily upgraded equipment, how could they possibly *know* yet that blip transients cannot *ever* be detected by both detectors at the same time? The same question applies to their bald-faced *assumption* about blip transients *never* "chirping" occasionally. If because of various environmental factors, it's just a "rare" blip transient that chirps and can be observed by both detectors, it would still end up being classified as a gravitational wave "discovery".
But this is your standard, not the standard set by the experiment, and I have to say that I think yours is unreasonable. [/quote]The bottom line here is that there is no way to be sure that any particular candidate signal is celestial in origin without some type of visual or neutrino confirmation of that claim. Without it, the candidate signal should simply end up in an "unknown origin" category at best case, certainly not a 'discovery of aliens' category as in my simplified example.
It's the *scientific* standard to not use a methodology which favors one explanation over another. In this case their "experiment" didn't favor anything, but their "methodology" certainly favors all celestial origin claims, and certainly disfavors everything else. A level playing field is a reasonable standard. A non level playing field is not a reasonable standard, particularly when you're trying to claim that you've "discovered" something new.
Says who? The one published paper that I cited in my PDF predicts that the merger will emit more energy in the EM spectrum than in gravitational waves.First of all BH mergers are not expected to have a counterpart, or if they have it would be weak.
Yet you claim to "see" them in "gravitational waves", but quite miraculously not a single one of the three published events manages to emit enough EM radiation to be observed in *any* satellite or neutrino detector on Earth or in space.Second, these events are very distant.
Were did you get your original brightness figure from?We worked out together a difference in apparent and absolute magnitude of 40 for z=0.2. So they will be faint (at least BH mergers will be faint - NSBH and NS mergers are expected to be brighter).
How do you "know" that the EM emissions would be "short lived"? Supernova events last a long time due to supposed "time dilation", and yet not one of these events was even seen in gamma ray burst detectors or neutrino detectors either, neither of which requires a particularly long signal.Third they are very short lived, particularly BH electromagnetic counterparts if they are detectable at all.
Gamma ray burst detectors can pinpoint a powerful event in very short order and they are often used to point other instruments. The fact that LIGO's job remains "difficult" doesn't give them the right to cut corners.And fourth, they require the good luck to have a powerful telescope looking in exactly the right direction at the right time.
That specific choice is pure confirmation bias, and instantly favors celestial claims and disfavors all other possible causes of the signal which *require* a counterpart or they are rejected.So counterparts are not regarded as necessary for a detection.
Yet that entire community has been 0 for 3 in terms of providing any visual support of their claims, while I remain 3 for 3 in my prediction that since the signals are not likely to be celestial in origin, there is therefore no EM 'counterpart' to find. So far I'm batting 100 percent, while the entire community is batting 0. All it would take is for even one of the three events to have be identified and it would be obvious that LIGO was right, and I was wrong, but alas the whole of astronomy has been unable to demonstrate that these signals are celestial in origin.You disagree and I don't see how that disagreement can be resolved by discussion. But it is you against the entire community.
I must say that the third "non detection" of an EM counterpart only made me more confident in my position, as well any additional non detection of EM counterparts in future papers on this topic. How is you claim even "falsifiable" or "testable" in comparison to mine *other than* your complete inability to produce one with an EM counterpart? How long do I have to wait to know if I'm right, and why shouldn't they have to wait before they claim that it's a "discovery" in the first place?
The sigma problem isn't really even the worst part of their methodology. The worst part of their methodology is that it is unable to differentiate itself from my interpretation of the "cause" of these signals being unlikely to be celestial in nature. The fact they can't even falsify their own claim says it all. It's a *terrible* methodology that they are using which is why they're batting 0 for 3 and I'm already 3 for 3.However, LIGO has engaged all along with the light astronomy folk, and sooner or later I expect a counterpart will be detected. I don't see anything wrong with you expressing thoughtful caution and saying that you don't accept the discovery until then (although the community disagrees), but I do think some of the things you're banging on about, sigma and the veto in particular, are ill-conceived.
They also claim to have 6 more possible candidate signals, and they would definitely publish one that had a visual confirmation if they had one, so we know that if the next paper doesn't have an EM counterpart, I'm probably already 9 for 9, and they're probably already 0 for 9. We'll have to wait and see what they publish next and see if it includes a EM counterpart, but I must say that I'm becoming more confident in my position every single time they fail to produce any visual support of their claim, or any neutrino support of their claim.
If I'm right, this is only going to become more obvious once three detectors are online, and nobody can find an EM counterpart when the region of the sky is well constrained. That's *assuming* that even all three detectors see the same signal at the same time, which might not even happen if the real cause of the signal is environmental in origin.
I think LIGO jumped the gun and they painted themselves into a difficult corner. Who's going to now admit a mistake if they indeed made one?
