toad.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
Mastodon server operated by David Troy, a tech pioneer and investigative journalist addressing threats to democracy. Thoughtful participation and discussion welcome.

Administered by:

Server stats:

273
active users

#phacking

0 posts0 participants0 posts today
Dr Mircea Zloteanu ☀️ 🌊🌴<p><a href="https://mastodon.social/tags/statstab" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>statstab</span></a> #363 p-checker The one-for-all p-value analyzer</p><p>Thoughts: Easy way to check for publication bias using some current tools.</p><p><a href="https://mastodon.social/tags/shiny" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>shiny</span></a> <a href="https://mastodon.social/tags/pvalue" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>pvalue</span></a> <a href="https://mastodon.social/tags/phacking" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>phacking</span></a> <a href="https://mastodon.social/tags/QRPs" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>QRPs</span></a> <a href="https://mastodon.social/tags/zcurve" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>zcurve</span></a> <a href="https://mastodon.social/tags/bias" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>bias</span></a> <a href="https://mastodon.social/tags/pcurve" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>pcurve</span></a> <a href="https://mastodon.social/tags/rindex" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>rindex</span></a></p><p><a href="https://shinyapps.org/apps/p-checker/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="">shinyapps.org/apps/p-checker/</span><span class="invisible"></span></a></p>
Dr Mircea Zloteanu ☀️ 🌊🌴<p><a href="https://mastodon.social/tags/statstab" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>statstab</span></a> #358 What are some of the problems with stepwise regression?</p><p>Thoughts: Model selection is not an easy task, but maybe don't naively try step wise reg.</p><p><a href="https://mastodon.social/tags/stepwise" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>stepwise</span></a> <a href="https://mastodon.social/tags/regression" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>regression</span></a> <a href="https://mastodon.social/tags/QRPs" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>QRPs</span></a> <a href="https://mastodon.social/tags/issues" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>issues</span></a> <a href="https://mastodon.social/tags/phacking" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>phacking</span></a> <a href="https://mastodon.social/tags/modelselection" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>modelselection</span></a> <a href="https://mastodon.social/tags/bias" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>bias</span></a></p><p><a href="https://www.stata.com/support/faqs/statistics/stepwise-regression-problems/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">stata.com/support/faqs/statist</span><span class="invisible">ics/stepwise-regression-problems/</span></a></p>
Gert :debian: :gnu: :linux:<p>Il P-hacking è la pratica di modificare l'analisi o i dati per ottenere un risultato statisticamente significativo. <br>Si cerca di ottenere un risultato desiderabile e si riportano solo i risultati ottenuti, ignorando tutte le volte in cui non si è ottenuto nulla. <br>Potrebbe portare a una pubblicazione a breve termine, ma il P-hacking contribuisce alla crisi di riproducibilità e replicabilità nella scienza, riempiendo la letteratura scientifica di conclusioni dubbie o infondate.<br><a href="https://qoto.org/tags/science" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>science</span></a> <a href="https://qoto.org/tags/statistic" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>statistic</span></a> <a href="https://qoto.org/tags/phacking" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>phacking</span></a> <br><a href="https://www.nature.com/articles/d41586-025-01246-1" rel="nofollow noopener" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">nature.com/articles/d41586-025</span><span class="invisible">-01246-1</span></a></p>
Felix Schönbrodt<p><a href="https://scicomm.xyz/tags/phacking" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>phacking</span></a> <a href="https://scicomm.xyz/tags/LLM" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>LLM</span></a> performance:</p><p>"The researchers found that big players like Meta, Google, OpenAI, and Amazon are given special privileges to privately test multiple versions of their models and only publish the best results. This hidden practice allows them to inflate their rankings by cherry picking data, making their models appear stronger than they actually are."</p><p><a href="https://arxiv.org/abs/2504.20879?utm_source=beehiiv&amp;utm_medium=newsletter&amp;utm_campaign=mediamobilize&amp;_bhlid=045dede5ad6eedcb96ec953f2fbac11a166a2243" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">arxiv.org/abs/2504.20879?utm_s</span><span class="invisible">ource=beehiiv&amp;utm_medium=newsletter&amp;utm_campaign=mediamobilize&amp;_bhlid=045dede5ad6eedcb96ec953f2fbac11a166a2243</span></a></p><p>via Sabine Hossenfelder's newsletter</p>
Dr Mircea Zloteanu ☀️ 🌊🌴<p><a href="https://mastodon.social/tags/statstab" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>statstab</span></a> #330 Encourage Playing with Data and Discourage Questionable Reporting Practices</p><p>Thoughts: What are and aren't "Questionable Research Practices"? Where is the "grey area"? Interesting opinion piece.</p><p><a href="https://mastodon.social/tags/QRPs" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>QRPs</span></a> <a href="https://mastodon.social/tags/exploratory" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>exploratory</span></a> <a href="https://mastodon.social/tags/EDA" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>EDA</span></a> <a href="https://mastodon.social/tags/posthoc" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>posthoc</span></a> <a href="https://mastodon.social/tags/phacking" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>phacking</span></a></p><p><a href="https://link.springer.com/article/10.1007/s11336-015-9445-1" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">link.springer.com/article/10.1</span><span class="invisible">007/s11336-015-9445-1</span></a></p>
Dr Mircea Zloteanu ☀️ 🌊🌴<p><a href="https://mastodon.social/tags/statstab" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>statstab</span></a> #168 Large P-Values Cannot be Explained by Power Analysis</p><p>Thoughts: "Researchers cannot “aim” for p = .05, not even with a careful, perfectly accurate, power analysis."</p><p><a href="https://mastodon.social/tags/research" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>research</span></a> <a href="https://mastodon.social/tags/nhst" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>nhst</span></a> <a href="https://mastodon.social/tags/pvalues" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>pvalues</span></a> <a href="https://mastodon.social/tags/power" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>power</span></a> <a href="https://mastodon.social/tags/QRPs" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>QRPs</span></a> <a href="https://mastodon.social/tags/phacking" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>phacking</span></a></p><p><a href="https://quentinandre.net/post/large-pvalues-and-power-analysis/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">quentinandre.net/post/large-pv</span><span class="invisible">alues-and-power-analysis/</span></a></p>
Dr Mircea Zloteanu ☀️ 🌊🌴<p><a href="https://mastodon.social/tags/statstab" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>statstab</span></a> #135 {p-checker} The one-for-all p-value analyzer</p><p>Thoughts: Why not try your hand at some tools for detecting publication bias (mileage may vary). Useful teaching demo tools.</p><p><a href="https://mastodon.social/tags/shinyapp" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>shinyapp</span></a> <a href="https://mastodon.social/tags/r" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>r</span></a> <a href="https://mastodon.social/tags/rstats" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>rstats</span></a> <a href="https://mastodon.social/tags/phacking" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>phacking</span></a> <a href="https://mastodon.social/tags/pvalues" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>pvalues</span></a> <a href="https://mastodon.social/tags/NHST" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>NHST</span></a> <a href="https://mastodon.social/tags/education" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>education</span></a> <a href="https://mastodon.social/tags/edu" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>edu</span></a></p><p><a href="https://shinyapps.org/apps/p-checker/" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://</span><span class="">shinyapps.org/apps/p-checker/</span><span class="invisible"></span></a></p>
Bjørn Sætrevik<p>Table 1 of the "False-positive psychology" paper (Simmons, Nelson &amp; Simonsohn 2011, <a href="https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2916240" rel="nofollow noopener" target="_blank"><span class="invisible">https://</span><span class="ellipsis">papers.ssrn.com/sol3/papers.cf</span><span class="invisible">m?abstract_id=2916240</span></a>) estimate the false-positive rate of some questionable <a href="https://fediscience.org/tags/ResearchPractices" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ResearchPractices</span></a>, both alone and in combination (see attached figure). </p><p>I remember reading somewhere that the authors later stated that the numbers were inaccurate and should have been somewhat higher. Does anyone have a reference for this? <a href="https://fediscience.org/tags/FalsePositivePsychology" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>FalsePositivePsychology</span></a> <a href="https://fediscience.org/tags/QRP" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>QRP</span></a> <a href="https://fediscience.org/tags/phacking" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>phacking</span></a> <a href="https://fediscience.org/tags/HARKing" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>HARKing</span></a> <a href="https://fediscience.org/tags/ReproducibiliTea" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ReproducibiliTea</span></a></p>
Karthik Srinivasan<p>A nice hatchet job from the New Yorker! </p><p><a href="https://www.newyorker.com/magazine/2023/10/09/they-studied-dishonesty-was-their-work-a-lie" rel="nofollow noopener" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">newyorker.com/magazine/2023/10</span><span class="invisible">/09/they-studied-dishonesty-was-their-work-a-lie</span></a></p><p>The story of morally and intellectually bankrupt superstar researchers who elevated what is/was/has always been a somewhat semi-decent, hardly scientific enterprise called behavioral economics (within social psychology) into a juggernaut of "just-so stories" that swayed nations, industries and academias to form absolutely horrendous worldviews and make decisions likewise. </p><p>The field: The poor need to be nudged (read, extra inconvenience) to make rational decisions with marginally any value to them. Meanwhile, dear corporations, here are some tax write-offs and subsidies; you can also engage in open thievery. That's our way to nudge you to do the right thing, i.e., fudging with the accounts. This is how we social engineer (All this, based on absolutely moronic and morally dubious "studies". I am reminded of the evo-psych psychopaths). </p><p>As if economics as it stands isn't dismal and unscientific enough, whether you legitimize with a couple Nobels or not, this is like "polishing a turd".</p><p>Of course not much is likely to change in academia across fields as well. It will continue to seek and hire more such people who will bring the money, fame, and storytelling at the expense of hard work and reality. Knowledge building and intellectual work... what's that? </p><p><a href="https://neuromatch.social/tags/Dishonesty" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Dishonesty</span></a> <a href="https://neuromatch.social/tags/Academia" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Academia</span></a> <a href="https://neuromatch.social/tags/BehavioralEconomics" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>BehavioralEconomics</span></a> <a href="https://neuromatch.social/tags/Management" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Management</span></a> <a href="https://neuromatch.social/tags/BusinessSchools" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>BusinessSchools</span></a> <a href="https://neuromatch.social/tags/Economics" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Economics</span></a> <a href="https://neuromatch.social/tags/Nudge" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Nudge</span></a> <a href="https://neuromatch.social/tags/pHacking" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>pHacking</span></a> <a href="https://neuromatch.social/tags/SocialPsychology" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>SocialPsychology</span></a></p>
Research Network Digi-Oek.ch<p>[en] Cheating in Science: Harvard "Honesty Scholar" May Have Been Caught in Dishonesty</p><p>"... dishonesty can lead to creativity" - an interesting and somewhat amusing read. </p><p>The New York Times: "Questions about a widely cited paper are the latest to be raised about methods used in <a href="https://social.tchncs.de/tags/behavioral" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>behavioral</span></a> research."</p><p><a href="https://datacolada.org/111" rel="nofollow noopener" target="_blank"><span class="invisible">https://</span><span class="">datacolada.org/111</span><span class="invisible"></span></a></p><p><a href="https://social.tchncs.de/tags/ResearchHighlights" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ResearchHighlights</span></a> <a href="https://social.tchncs.de/tags/honesty" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>honesty</span></a> <a href="https://social.tchncs.de/tags/dishonesty" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>dishonesty</span></a> <a href="https://social.tchncs.de/tags/phacking" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>phacking</span></a> <a href="https://social.tchncs.de/tags/harking" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>harking</span></a> <a href="https://social.tchncs.de/tags/dredging" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>dredging</span></a> <a href="https://social.tchncs.de/tags/gino" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>gino</span></a> <a href="https://social.tchncs.de/tags/harvard" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>harvard</span></a> <a href="https://social.tchncs.de/tags/fraud" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>fraud</span></a> <a href="https://social.tchncs.de/tags/cheating" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>cheating</span></a> <a href="https://social.tchncs.de/tags/academic" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>academic</span></a> <a href="https://social.tchncs.de/tags/datacolada" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>datacolada</span></a></p>
Nicola Righetti<p>“It’s a bit like seeing a rabbit shape in the clouds and then testing whether all clouds look like rabbits… using the same cloud. I hope you appreciate that you’re going to need some new clouds to test your theory.</p><p>Any datapoint you use to inspire a theory or question can’t be used to test that same theory.”</p><p><a href="https://sciences.social/tags/phacking" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>phacking</span></a> <a href="https://sciences.social/tags/statistics" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>statistics</span></a> <a href="https://sciences.social/tags/rstats" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>rstats</span></a></p><p><a href="https://towardsdatascience.com/the-most-powerful-idea-in-data-science-78b9cd451e72" rel="nofollow noopener" target="_blank"><span class="invisible">https://</span><span class="ellipsis">towardsdatascience.com/the-mos</span><span class="invisible">t-powerful-idea-in-data-science-78b9cd451e72</span></a></p><p><span class="h-card"><a href="https://a.gup.pe/u/sociology" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>sociology</span></a></span> <span class="h-card"><a href="https://a.gup.pe/u/communicationscholars" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>communicationscholars</span></a></span> <span class="h-card"><a href="https://a.gup.pe/u/rstats" class="u-url mention" rel="nofollow noopener" target="_blank">@<span>rstats</span></a></span></p>
Anita Graser 🇪🇺🇺🇦🇬🇪<p>"Do not chase better metrics. Chase better models."</p><p>Excellent lighting talk on how spatial sampling affects the quality of data driven models by Luísa Lucchese</p><p><a href="https://youtu.be/q9dy2dQuTak" rel="nofollow noopener" target="_blank"><span class="invisible">https://</span><span class="">youtu.be/q9dy2dQuTak</span><span class="invisible"></span></a></p><p>Chasing better <a href="https://fosstodon.org/tags/metrics" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>metrics</span></a> is like <a href="https://fosstodon.org/tags/phacking" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>phacking</span></a> </p><p><a href="https://fosstodon.org/tags/GeoAI" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>GeoAI</span></a> <a href="https://fosstodon.org/tags/gischat" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>gischat</span></a> <a href="https://fosstodon.org/tags/datascience" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>datascience</span></a> <a href="https://fosstodon.org/tags/machinelearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>machinelearning</span></a></p>
Carl T. Bergstrom<p>If you’re interested in <a href="https://fediscience.org/tags/statistics" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>statistics</span></a>, <a href="https://fediscience.org/tags/Metascience" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Metascience</span></a>, <a href="https://fediscience.org/tags/openScience" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>openScience</span></a>, <a href="https://fediscience.org/tags/pHacking" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>pHacking</span></a>, etc., this is quite a good read. </p><p><a href="https://joebakcoleman.com/blog/2023/pcurve/" rel="nofollow noopener" target="_blank"><span class="invisible">https://</span><span class="ellipsis">joebakcoleman.com/blog/2023/pc</span><span class="invisible">urve/</span></a></p>
Isi Schneider<p>just a little engineering mishap I guess, low probability to happen, but HUGE effect size 🤣🤣🤣<br><a href="https://mstdn.science/tags/Science" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Science</span></a> <a href="https://mstdn.science/tags/pHacking" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>pHacking</span></a></p>