NeoGAF Thread Summarizer - Read high impact posts in threads, track replies

Status
Not open for further replies.
May 23, 2013
4,624
0
0
Turkey
www.hesido.com
#1
NeoGAF Thread Summarizer is an easy to use Google Chrome Extension that allows you to:
  • New: Live Thread Functionality, extension reports new posts after analysis (1.7.x)
  • View branching posts (track conversations) (1.5.x)
  • Track conversations during normal thread view. (1.6.x)
  • List posts with the most quotes in a thread, along with the posts that quoted it.
  • Track messages of your or anyone's posts in a thread, along with the quoting posts.
  • Instantly load pages from the cache used to analyze the thread for fast navigation
New generation Opera users can use the extension by downloading it from GitHub.

There is also an Opera 12 version that is maintained separately and does not have all the features.

You can see it in action in a video.: https://www.youtube.com/watch?v=wqGqDc23anM

Example gif of "new posts available" feature


Chrome extension (v 1.7.0.2):
https://chrome.google.com/webstore/detail/neogaf-thread-summarizer/aaclblmjeibhbaniomgigpbchbmbdhlk
Opera 12 extension (Called NeoGAF Companion, maintained as a separate branch and not feature complete):
http://www.neogaf.com/forum/showpost.php?p=157945786&postcount=59

Tested to work with Chrome 41.0.2272.118, 42.x (Stable beta), 44.x (Canary nightly builds), however, some Chrome "point update" versions may have bugs preventing this from working.

If you are using Chrome 41.x or lower, you may need to install a previous version as the latest versions seem to not work for some users, here's a fallback version (1.2.2). You can check out the source, and install it in developer mode.
https://www.dropbox.com/s/meu1j59sbmq38tp/neogaf_thread_summarizer1_2_2.zip?dl=0

So if things are not working, either upgrade your Chrome, or downgrade your script.


How to use:
You go to the first page of the thread, hit begin analysis, it sweeps all the rest of the pages. You can start from the middle of the thread, it only analyses the later half of the thread. After it's done, hit show results, after setting the quote threshold you like.
Questions not yet asked but the potential is there:
Q: I hit analysis and it doesn't find any quoted posts, or the amount of posts is very low.
A: It only analyses pages beginning from the page you are on, to the last page. If you hit "analyse" on the last page, it just analyses that page.

Current version: 1.7.0.2 -updated 24/03/2016 (Listed features may not be present in Opera 12 version (v.0.9.2))

ToDo:
  • Keep track of posts of specific user(s) in the thread. done
  • Keep track of posts that quote a specific user (that could be you) done
  • Do analysis without changing pages, in background. done
  • Cached page limit setting with dynamic page caching during thread navigation
  • Use cached pages for instant post retrieval done
  • Display a basic graph about quoted posts
  • Do recursive quote tracking so one can follow back and forth replies between users without having to add them to the follow list. done
  • Do reply tracking on a post by post basis instead of inside a thread using contextual menu. May be used to track replies to specific posts in post search results.
  • Kick start analysis from forum thread list pages using contextual menus
  • Word cloud of the thread
  • Dedicated options page done
  • Do silent analysis as you move through a thread. (would be optional)
  • Populate thread posts with info from analysis. done
  • Add NeoGaf live like functionality, checking for latest posts (in classical paginated form instead of infinite vertical page). done
  • Save settings in cloud / locally so when you close browser, your last settings will be remembered. done

The core functionality is tested for a good while so things should be OK. You'll see an icon on the url bar, you can start analyzing and it analyzes from the page you are on to the last page.

Currently released under Zlib license.

I'll shamelessly bump this thread for updates even if doesn't get replies for now. Please let me know of any suggestions.

Change log on extension page and in the extension files.
 
Dec 13, 2013
9,984
0
0
#14
Lionel Mandrake out of a job.


2027
SOMEWHERE IN CYBERSIDE



"...o I was on Marvel-Topic, n then this Gaming tard was all like in my day blabla 108--"

OOF!
*crash*

"?¿?... lol2.4, watch where ur surfing, Senior- :)"

"awww he looks so sad, anx stupid keeeekee! look, he duzn't even have vox"

"match XD yeah, so's I was saying, I was on M..."











...


*pat pat, rustle, ft- ft*

*step*

*step*




*step*


*flink- ssssssszzz...*


puff~

puff~

[text com]
Sigh...

Good evening...? Ha; a gaffe.

It wasn't always like this. But they're all dead now.

And if not dead, then Converted.

Thus, so they are.
[/text com]

puff~
(the installation looms)

[text com]
Hmph... 'duzn't even have vox'. Pah.

...I used to speak. Back when words meant something, when it was the prose in context that was the volume, every letter a decibel.

They used to lay roses at my feet. Roses with petals that fluttered endlessly and impossibly when you stared, cradled in neat little boxes. Each, a heartfelt GIF't. I remember one who was my skill equal in this field, my compatriot-

And then, It was born.

He was one of the first to succumb to It. Converted to use It.

He was as high as the Sun with It.

'Now I don't have to read through pages of shitposts to find my muses anymore. It's like a portable 24/7 version of you, lol,' he PM'd me that fuck of a day.

No integrity, just like all legends.
[/text com]

puff puff~

(drop)
*step- shkshk shk*

[text com]
I, was an orator. THE orator. With zealots' conviction they once marauded across the weave of these threads, eyes open for me, ears perked for ME. With bated breath, they once awaited ME to step over the rise with the tablets, not for a godless automaton, not for a soulless codifier!
[/text com]

*rustle*
(withdraws a thermite virus from duster's pocket INV)
(stares up at installation: NeoGAF Server-side, Online V. - CENSOR/SUMMARY.EXE)

[text com]
All these years-

As a lion, I held my breath in hiding.
[/text com]

(the avatar scrambles over the firewall; his coat flutters-)

[text com]
As a man, I breathed language to define.
[/text com]

(the Reds apparate before him, closing in-)

[text com]
As a drake, I breathe fire-

And so GAF, farewell, and good night.
[/text com]

*fting- beep~*
 
May 23, 2013
4,624
0
0
Turkey
www.hesido.com
#15
Lionel Mandrake out of a job.
We still need his human touch..

It does an analysis of the thread, it puts it in its cache until you shut down chrome or tell it to delete the thread cache. It then shows you posts that are quoted with a threshold you set. You can set different tresholds without having to re-analyse.

Also, any plans for a Greasemonkey/Violentmonkey/Other format compatible with Opera version?
I don't think I'll be the one to do it. I'll release the full code under Zlib, and people could adapt it I guess. I could also work with programmers here who wish to co-develop it with me.

I wish it let you search by user, so I could search the whole forum to find which post of mine was quoted the most.
It will let you search for posts by specific users and let you know how many times it's been quoted.

Anybody who tried it and made it work?
 
#21
You mean for old (classic) pre-chromium Opera? (I think I'll try a conversion because you seem to represent at least 50% of people (!) who's interested in this extension but I want to make sure if that's what you're asking!)
Yeah, the Opera Classic, 12.17

And, indeed, at least you know there's demand from somewhere -
Me =)
 
May 23, 2013
4,624
0
0
Turkey
www.hesido.com
#22
I've downloaded the extension development documents, they no longer support distribution of those old extensions, I guess? I'll just send a link to the zip and you could install it in developer mode.

I'll see what can be done. I'm using some newly introduced javascript methods for my coding pleasure as I haven't thought of any other browsers and I'll see if it works in the classic Opera. Otherwise I'll have to also include "polyfills" for those. It could be a lot of work, I'd keep my expectations low :)

I have not even installed the latest Opera btw. I have 12.16 installed here.. Long time Opera users, switched to Chrome after Opera went Chrome and ditched everything that was Opera (even though they had announced they would keep the core Opera functions..)
 
#23
I've downloaded the extension development documents, they no longer support distribution of those old extensions, I guess? I'll just send a link to the zip and you could install it in developer mode.

I'll see what can be done. I'm using some newly introduced javascript methods for my coding pleasure as I haven't thought of any other browsers and I'll see if it works in the classic Opera. Otherwise I'll have to also include "polyfills" for those. It could be a lot of work, I'd keep my expectations low :)

I have not even installed the latest Opera btw. I have 12.16 installed here.. Long time Opera users, switched to Chrome after Opera went Chrome and ditched everything that was Opera (even though they had announced they would keep the core Opera functions..)
See if the info in this thread is of any help, maybe?

http://www.neogaf.com/forum/showthread.php?t=944860

(In particular, my posts, the posts I'm replying to, and the posts replying to me)


Thanks for taking the time, I appreciate it =)
 
May 23, 2013
4,624
0
0
Turkey
www.hesido.com
#24
See if the info in this thread is of any help, maybe?

http://www.neogaf.com/forum/showthread.php?t=944860

(In particular, my posts, the posts I'm replying to, and the posts replying to me)


Thanks for taking the time, I appreciate it =)
No problems.. I think I'll go with the extension route instead of a userscript / greasemonkey script because then I'd have to change too many things, like provide a user interface from within the web page instead of relying on popup buttons. I've checked out your posts and replies to your posts btw, just analysed thread and typed your name :)
 
#25
No problems.. I think I'll go with the extension route instead of a userscript / greasemonkey script because then I'd have to change too many things, like provide a user interface from within the web page instead of relying on popup buttons. I've checked out your posts and replies to your posts btw, just analysed thread and typed your name :)
No problem, I understand.
I just like to advocate for my browser of choice when I can.

And, I thought you might do that :þ
 
May 23, 2013
4,624
0
0
Turkey
www.hesido.com
#26
Uh.. The API reference is ridiculously lacking. Doesn't list all properties, and you have to dig in the examples to see if anything you need is covered.

I'll try my best for the sake of good'ol Opera, it may take a few days before I can come up with something useful. I had been a very prominent user of Opera (you could call me an evangelist) back in the day.
 
#29
Uh.. The API reference is ridiculously lacking. Doesn't list all properties, and you have to dig in the examples to see if anything you need is covered.

I'll try my best for the sake of good'ol Opera, it may take a few days before I can come up with something useful. I had been a very prominent user of Opera (you could call me an evangelist) back in the day.
Hah, sounds fun :þ

And, yeah, I've been using Opera since I switched over from Netscape after 4.7, and had been using Netscape since 3.0 Gold.
I don't like change - so I'm going to keep using it as long as I can <3


For those of you just joining us...


This is bullshit.
Hey, at least you have your airline business to fall back on! <3
 
May 23, 2013
4,624
0
0
Turkey
www.hesido.com
#33
Hah, sounds fun :þ

And, yeah, I've been using Opera since I switched over from Netscape after 4.7, and had been using Netscape since 3.0 Gold.
I don't like change - so I'm going to keep using it as long as I can <3

Hey, at least you have your airline business to fall back on! <3
Ok.. I feel very much exhausted. I've been working on the classic Opera version.. Up till now, I did an entire re-write of the extension's messaging system. It certainly wasn't a case of search and replace. The behaviour is very different (e.g. popup cannot directly talk to the webpage, it has to go through extensions's background page.) and some basic stuff like simply storing an id to talk to a tab is out of the question. You can't change a tab's url so I had to work around it too.. And debugging is very hard compared to Chrome.. So yeah, I did all those re-writing.. The more stuff I had solve, the deeper I was in. The deeper I was in, the harder it was to stop...

Yet, after I solved all those problems, I realized a key method to load individual posts from servers is non-existent, or simply not available to a user scripts. Should have checked earlier. I may be able to adapt a jquery version of this, but I'm not sure if Opera allows any kind of ajax call from within a user-script.

So everything works right until the very last point. I'll still do one final push for it. Because I have spent way too much time on it, it's too hard to let go.

I'll stop working on the Opera version for the time being and I'll go back to working on this one. No one cares but I was having fun programming it. I can't say the same for the Opera version.
 

Rest

All these years later I still chuckle at what a fucking moron that guy is.
Feb 28, 2014
7,503
102
545
#34
I feel like with all of the GAF extensions I'm collecting I'm going to need a second install of Chrome just for GAF, so that it's not bloated for everything else.
 
#36
Ok.. I feel very much exhausted. I've been working on the classic Opera version.. Up till now, I did an entire re-write of the extension's messaging system. It certainly wasn't a case of search and replace. The behaviour is very different (e.g. popup cannot directly talk to the webpage, it has to go through extensions's background page.) and some basic stuff like simply storing an id to talk to a tab is out of the question. You can't change a tab's url so I had to work around it too.. And debugging is very hard compared to Chrome.. So yeah, I did all those re-writing.. The more stuff I had solve, the deeper I was in. The deeper I was in, the harder it was to stop...

Yet, after I solved all those problems, I realized a key method to load individual posts from servers is non-existent, or simply not available to a user scripts. Should have checked earlier. I may be able to adapt a jquery version of this, but I'm not sure if Opera allows any kind of ajax call from within a user-script.

So everything works right until the very last point. I'll still do one final push for it. Because I have spent way too much time on it, it's too hard to let go.

I'll stop working on the Opera version for the time being and I'll go back to working on this one. No one cares but I was having fun programming it. I can't say the same for the Opera version.
Aww, I'm really sorry you had to deal with all of that, and ran into those issues =(

I really appreciate you taking the time, though =)
 
May 23, 2013
4,624
0
0
Turkey
www.hesido.com
#37
I feel like with all of the GAF extensions I'm collecting I'm going to need a second install of Chrome just for GAF, so that it's not bloated for everything else.
This is an important thing, a badly coded extension may be slowing things down, doing unnecessary work even when not used.

Maybe the most popular extensions could be joined so all of them shares the background process... Many of those extension, I'm guessing, would not be using the background process extensively and would just modify the page so they should get along fine. The added memory footprint of this extension is less than an open tab with a very basic, no-image html page, and it hopefully doesn't do anything other than check the URL for a compatible web page, and its helper scripts only get injected in *.neogaf.com. One can check out the memory usage of extensions and web-pages alike in Chrome's own task manager. (shift+esc)

Also you can disable them at any time, as you know :)

Welcome to the club of 'maybe I should make an extension just for GAF...'.
It's a small club.
This looks really sweet though, gonna give it a spin next time something blows up on here.
That looks nifty, I'll try that out as well. I currently use my extension to track replies to me.

Aww, I'm really sorry you had to deal with all of that, and ran into those issues =(

I really appreciate you taking the time, though =)
No problems. Programming is probably good against Alzheimer's, so I have probably pushed it back a few years already..
 
Jan 8, 2011
989
0
0
UL, Ireland
#38
That looks nifty, I'll try that out as well. I currently use my extension to track replies to me.
Thanks. I hope it helps you keep track of stuff! It's not supposed to be a cure-all but it does what it does pretty well I think.

No problems. Programming is probably good against Alzheimer's, so I have probably pushed it back a few years already..
Alzheimer's is serious business. :( Sorry to hear that.
 
May 23, 2013
4,624
0
0
Turkey
www.hesido.com
#39
Thanks. I hope it helps you keep track of stuff! It's not supposed to be a cure-all but it does what it does pretty well I think.



Alzheimer's is serious business. :( Sorry to hear that.
No man.. I'm not Alzheimer's! But activities like problem-puzzle solving / programming has some protective value so, that was meant to be a joke. A poorly executed one at that. Sorry..

Actually, your extension could theoretically talk to my extension, and see if the quote has actually undisplayed quotes in them, and mark those accordingly. That was my first thought when I installed and used your extension..
 
May 23, 2013
4,624
0
0
Turkey
www.hesido.com
#40
Version 1.2 is released. Now all analysis is done in background. This should not only make things faster, as unnecessary stuff is not loaded, it should allow you to keep reading the tab you are on. I've re-written and modified quite a lot of the parts to do that.
 

AndyD

aka andydumi
Jan 24, 2007
19,101
0
0
Nashville, USA
#43
Thanks!

Now it shows up but all I get are "Thread status: Aborted: load errors"

I wonder if its an issue with other extensions. Autopagerize maybe? Or is it an issue that I have Chrome not to run plugins?
 
May 23, 2013
4,624
0
0
Turkey
www.hesido.com
#44
Thanks!

Now it shows up but all I get are "Thread status: Aborted: load errors"

I wonder if its an issue with other extensions. Autopagerize maybe? Or is it an issue that I have Chrome not to run plugins?
Hmm, the pages are still tried to be loaded using www. prefix.. Do you have it blocked? Or in other words, why do you specifically need neogaf.com instead of www.neogaf?

I don't think it would be affected by other extensions but if you just disable them to test if it works alone, that'd be interesting..

edit: Retracting, auto-pagerize could indeed potentially screw things up, as my script looks for the next page link and if the auto-pagerize is changing that link (which it probably does) things can break.. I'll download that and see how it works out. Anything that modifies the page links could be an offender.
 
May 23, 2013
4,624
0
0
Turkey
www.hesido.com
#47
Thanks!

Now it shows up but all I get are "Thread status: Aborted: load errors"

I wonder if its an issue with other extensions. Autopagerize maybe? Or is it an issue that I have Chrome not to run plugins?
OK, I have tested with auto-pagerize, and it still works. Maybe some other extension ,s at fault here. I'd be glad if you did some basic testing by disabling everything else and see it works. So far, I'm the only person that knows that this works, tho :)

A word cloud for the thread would be pretty sweet.
That's a cool idea. It should slow the analysis to some extent and increase the mem usage so I guess it would be optional. Have you tried this extension? As in, does it work for you in its current state?

brb writing an extension that just finds the Lionel Mandrake post with that picture of Malcom McDowell and immediately links to it.
:)
 

AndyD

aka andydumi
Jan 24, 2007
19,101
0
0
Nashville, USA
#48
Hmm, the pages are still tried to be loaded using www. prefix.. Do you have it blocked? Or in other words, why do you specifically need neogaf.com instead of www.neogaf?

I don't think it would be affected by other extensions but if you just disable them to test if it works alone, that'd be interesting..

edit: Retracting, auto-pagerize could indeed potentially screw things up, as my script looks for the next page link and if the auto-pagerize is changing that link (which it probably does) things can break.. I'll download that and see how it works out. Anything that modifies the page links could be an offender.
Actually www.neogaf is blocked here by filters, but neogaf is not. So that's probably why there's still an issue. Because now it works on the surface, but under the hood, it still looks for www.

A word cloud for the thread would be pretty sweet.
That would be neat. Also a popular image posted and quoted aggregator?
 
May 23, 2013
4,624
0
0
Turkey
www.hesido.com
#50
Actually www.neogaf is blocked here by filters, but neogaf is not. So that's probably why there's still an issue. Because now it works on the surface, but under the hood, it still looks for www.



That would be neat. Also a popular image posted and quoted aggregator?
That "most quoted" image thing came to my mind but when a popular image is quoted, they go into the top quoted posts. However, we could have a sort option or maybe a filter option such as "most quoted posts that have images in them".

I have updated to 1.2.2, it now obeys your preferred prefix. This should fix your problems, I hope! I don't know if it is made active yet. If it says 1.2.2, go for it and let me know.

Opera12.17Opera12.17Opera12.17Opera12.17
>.>
:( Believe me I have tried. I'll give it a go later on but I'll first make sure if extensions are allowed to actually load stuff from urls. Then I'll have to add a javascript html parser library as that version of Opera doesn't support "document" type dom http requests. If you know of an open source opera extension that dynamically loads stuff, please point me to that direction so I can check that out.
 
Status
Not open for further replies.