Not signed in (Sign In)

Vanilla 1.1.2 is a product of Lussumo. More Information: Documentation, Community Support.

General: Duplicate items

Bottom of Page

1 to 12 of 12

  1.  
    • CommentAuthorhardy24
    • CommentTimeOct 7th 2005
     
    Not a problem with gregarius, so much as a feature request, in several instances, I'm subscribed to several feeds from the same news website (sport, technology, entertainment, main news, etc) but very often the content of those feeds overlaps, and a item may appear in two feeds at the same time (say entertainment and technology) is it possible for gregarius to check when updating feeds and only return any dupicated items once?
    •  
      CommentAuthorsameerd
    • CommentTimeOct 7th 2005
     
    ha ha ha. All you get from me on this is maniacal laughter.
    •  
      CommentAuthorsameerd
    • CommentTimeOct 7th 2005
     
    *stops laughing* This is the usual response when anyone mentions gregarius and duplicates in the same sentence. *starts laughing again*.

    But seriously, your feature request does sound interesting.
    •  
      CommentAuthormbi
    • CommentTimeOct 7th 2005
     
    Sameer, stop laughing or I enable rounded corners everywhere again! ;)
    • CommentAuthorjerobins
    • CommentTimeOct 7th 2005
     
    All ya gotta do is md5sum the description of every article and filter the dupes. Please submit a patch when you're done. :-)
    • CommentAuthorhardy24
    • CommentTimeOct 7th 2005
     
    I had a feeling gregarius and duplicates was a sensistive subject from some previous tickets on trac.

    Oh, and what is with the rounded corners, everytime I update it seems to be different.

    Jerobins, I would do this myself, but I don't really have the expertise to do this myself, I wish I did, I'm purely a 'tester'.
    • CommentAuthorjerobins
    • CommentTimeOct 7th 2005
     
    good grief. no wonder duplicates are a problem, magpie doesn't handle guid's.
    •  
      CommentAuthormbi
    • CommentTimeOct 7th 2005
     
    Ok, Daniel's request wouldn't be very hard to implement, technically speaking: as James suggested we check the md5 sum of new items against those in the database, but this would be a performance nightmare on the server.

    Sorry, Daniel, don't hold your breath on this one :(
    • CommentAuthorjerobins
    • CommentTimeOct 7th 2005
     
    i'm gonna look at this in my copius amounts of spare time....not the md5($description), but actually grabbing rss/atom guid's.
    •  
      CommentAuthorsameerd
    • CommentTimeOct 8th 2005
     
    Not all feeds implement guid. I think it is an optional item. So we will need to work around that.
    • CommentAuthorjerobins
    • CommentTimeOct 8th 2005
     
    You, sir, are correct; however, most do include them and a workaround is manageable.
    • CommentAuthorhardy24
    • CommentTimeOct 8th 2005
     
    mbi, it might cut down on the 'performance nightmare on the server' if in the admin area you could tell gregarius which feeds where in danger of overlapping, and to only run a comparison on those feeds.

1 to 12 of 12

  1.