Allow duplicate links in RSS feeds ? [Integrated]

Workflow

Support request

Status

Solution has been fully integrated

Submission on Dec. 18 2006 by NickR
Qualification on Dec. 18 2006 by Bernard
Finalization on June 9 2008 by Christian

Progress

I have an rss-feed incoming to my website which lists music I am listening to (via last.fm but obviously I listen to the same set of music many times, but because of this, yacs treats these as duplicates and wont update a correct list of what I am listening to... Recent Music

I am not sure if that is a fault of the way I am using RSS or the way I am wanting to use YACS...

Cheers, Nick

Comments

Bernard Paquesfrom nearby-an-airport Associate, 8405 posts	on Dec. 18 2006 That's a bug, undoubtedly. However, code in function `Link::have()` in links/links.php and `Feeds::tick_hook()` in feeds/feeds.php look ok at first sight. What do you think?
NickR	inspired from Bernard on Dec. 19 2006 Bernard: Having a look at feeds.php, line 352, there is code to skip existing links - its not a bug - I am working against the way the code was designed. Its a useful feature to have, eg aggregating multiple feeds and removing duplicates is worthwhile. In my case it would be useful to allow duplicates (could we repeat the link entry (id) rather than create a duplicate I am not sure how would be best to achieve this - maybe a config option somewhere to allow duplicate RSS feed links ? Being able to limit the number of links in this section would also make sure that duplicates were eliminated eventually - I only need 10 to 50 items, no need to keep them indefinitely. Hope this info helps. Nick
Bernard Paquesfrom nearby-an-airport Associate, 8405 posts	on Dec. 24 2006 Maybe it would make more sense to "refresh" existing links, to make them move to the top of the list.
NickR	inspired from Bernard on Dec. 26 2006 " Maybe it would make more sense to "refresh" existing links, to make them move to the top of the list. " Sounds good to me
Bernard Paquesfrom nearby-an-airport Associate, 8405 posts	inspired from NickR on Dec. 27 2006 NickR: added to the to do list
Udut Kennethfrom Naples, FL 52 posts	on Sep. 29 2007 I was having trouble with duplicate links coming from different feed sources. The solution that worked for me was using this SQL query: (mySQL) SELECT `link_url` , count( 'link_url' ) FROM `yacs_links` GROUP BY 'link_url' HAVING count( 'link_url' ) >1 to show me all of the URLs that are duplicated in my links. then I can go through figure out the biggest duplicates and start eliminating. Some of my biggest were google videos I was pulling in from several search queries. [but Google is known for proving duplicates in their feeds] Anyhow, I hope this helps someone! It is SAFE - it does NOT DELETE ANYTHING. It merely shows how many duplicated records you have. P.S. - Just updated the query: Changed to SELECT * which will show the whole record. I'm new at SQL so this is exciting to me. SELECT * , count( 'link_url' ) FROM `yacs_links` GROUP BY 'link_url' HAVING count( 'link_url' ) >10 ORDER BY `anchor` DESC
Christianfrom Chonas l'Amballan Associate, 2039 posts	on June 9 2008 I close this topics but keep it for 8.6 tests ! Actupro quelques sites yacs : création site internet annuaire pro