Allow duplicate links in RSS feeds ? [Solved]

Rhodes, Nick -- on Dec. 18 2006, from West Yorkshire, UK
YACS team (UK)

Solution has been fully integrated

Solution Manager: Bernard

Issue description

I have an rss-feed incoming to my website which lists music I am listening to (via last.fm but obviously I listen to the same set of music many times, but because of this, yacs treats these as duplicates and wont update a correct list of what I am listening to... Recent Music

I am not sure if that is a fault of the way I am using RSS or the way I am wanting to use YACS...

Cheers, Nick

Comments

Bernard from nearby-an-airport Associate, 6734 posts	on Dec. 18 2006 That's a bug, undoubtedly. However, code in function `Link::have()` in links/links.php and `Feeds::tick_hook()` in feeds/feeds.php look ok at first sight. What do you think?
NickR from West Yorkshire, UK 332 posts	inspired from Bernard on Dec. 19 2006 Bernard: Having a look at feeds.php, line 352, there is code to skip existing links - its not a bug - I am working against the way the code was designed. Its a useful feature to have, eg aggregating multiple feeds and removing duplicates is worthwhile. In my case it would be useful to allow duplicates (could we repeat the link entry (id) rather than create a duplicate I am not sure how would be best to achieve this - maybe a config option somewhere to allow duplicate RSS feed links ? Being able to limit the number of links in this section would also make sure that duplicates were eliminated eventually - I only need 10 to 50 items, no need to keep them indefinitely. Hope this info helps. Nick
Bernard from nearby-an-airport Associate, 6734 posts	on Dec. 24 2006 Maybe it would make more sense to "refresh" existing links, to make them move to the top of the list.
NickR from West Yorkshire, UK 332 posts	inspired from Bernard on Dec. 26 2006 " Maybe it would make more sense to "refresh" existing links, to make them move to the top of the list. " Sounds good to me
Bernard from nearby-an-airport Associate, 6734 posts	inspired from NickR on Dec. 27 2006 NickR: added to the to do list
Simplify3 47 posts	on Sep. 29 2007 I was having trouble with duplicate links coming from different feed sources. The solution that worked for me was using this SQL query: (mySQL) SELECT `link_url` , count( 'link_url' ) FROM `yacs_links` GROUP BY 'link_url' HAVING count( 'link_url' ) >1 to show me all of the URLs that are duplicated in my links. then I can go through figure out the biggest duplicates and start eliminating. Some of my biggest were google videos I was pulling in from several search queries. [but Google is known for proving duplicates in their feeds] Anyhow, I hope this helps someone! It is SAFE - it does NOT DELETE ANYTHING. It merely shows how many duplicated records you have. P.S. - Just updated the query: Changed to SELECT * which will show the whole record. I'm new at SQL so this is exciting to me. SELECT * , count( 'link_url' ) FROM `yacs_links` GROUP BY 'link_url' HAVING count( 'link_url' ) >10 ORDER BY `anchor` DESC
Christian from Chonas l'Amballan Associate, 779 posts	on June 9 I close this topics but keep it for 8.6 tests !

7 comments

Rate this page
Posted by NickR on Dec. 18 2006, page edited by Christian on June 9, (popular)