Follow

Paper.li Is Not Picking Up All of the Content You Expect

 

If you notice content missing from your paper, check these reasons to troubleshoot why:

 

1. Does the post fall within the relevant timeframe?

Paper.li searches the previous xx hours (24 if daily,  every 12 hours for twice daily or 7 days for weekly) for unique links (URLS) shared by you, according to the sources and key word searches you have chosen.

For Twitter, check the timestamp link on the top right of the tweet to be sure the tweet falls within the correct timeframe.  

For G+, dates are also included in the posts and will only be pulled if they fall within the correct timeframe.

For RSS feeds, check the feed to verify that recent content has been published by adding your RSS to any RSS reader.  (eg feedly.com)  

For youtube, dates are included in a posted video and will only be pulled if they fall within the correct timeframe.

Troubleshooting advice: Does the date of the missing post/tweet meet the criteria of your update period? If you are using an RSS feed, can the RSS feed be found in an RSS reader and if so, is there recent content?

Note also that if you the time of the tweet or post was too close to the publish time, the tweet or post is occasionally skipped over.  If you believe that there is more recent content that the platform has missed, clicking  Screen_Shot_2014-05-13_at_1.49.41_PM.png (found in your  Paper Settings Dashboard) will re-fetch the most recent content according to your sources.  

2. Is the post unique?  

We will only display unique links, so if there are multiple users tweeting identical links or sharing the same URL on Twitter we will take the first link detected (chronological order).

3.  Was the same link already included in the previous paper edition?  

We have a rule in place which eliminates duplicate content from showing on two consecutive auto-created editions.

4. Is the URL shared (via RSS or Twitter) a "fetchable" URL?

There are several reasons why our platform may not be able to fetch the content on the URL and display it:

a.  Check that the link is not broken.  We filter as best we can and discard any broken links found. 

b.  Check that the link is not protected by a password.  We are not able to present pages that are password protected.

c.  If not an image or video, check that the URL shared is a link to an article.   Our platform was designed to find and present articles, (images or videos).   If there is no article shared, we can not pass the link onto a Paper.li paper.

d.  Check that the link is not a root URL.  Root URLs (home pages) will not be presented in a paper.li since home pages do not share articles.  Example of a root URL:  nytimes.com or amazon.com

e. Are you using linkis.com to shorten your URLs?  We are not able to pull your content if you are using this link shortener because it uses an iframe for the content.  

Troubleshooting advice:  Use the bookmarklet to test the URL.  The content found (if any) will be shown in the bookmarklet.  If we are able to find an article, it will be shown, along with the default topic/category we've assigned.  

5. If you are using automatic ranking, does the article have a minimum of 1500 characters?

6. Are the post(s) being excluded because of your filters?

If you are using a key word, check that those users are tweeting or posting on Twitter using the keyword on that list and the filters you have set.

7. Does the language of the article match the language criteria you set?

If you have chosen to find content in a specific language , we will discard any content found that does not match the language you have chosen.  To check your language settings, go to your Paper Settings Dashboard, choose Content > Advanced Settings > Content language.   Please note: Our system currently fetches content in English, French, Spanish, Italian, Portuguese, Japanese, German and Dutch.

8. Have you excluded some Paper Sections?

If you have excluded specific Paper sections, but our system categorizes the content found under one of those excluded Paper sections, the content will not be published.  To check which Paper sections you have excluded, go to your Paper Settings Dashboard, click Content > Advanced Settings > Paper sections.  Look for which Paper sections are not selected.  

Troubleshooting advice: Use the bookmarklet to view how paper.li is categorizing the article.

The bookmarklet will show which Topic section we are assigning the article.  If in the below example, the Covered Topic "Politics" had previously not been selected, the article below would not have appeared in the paper.  

Screen_Shot_2014-03-03_at_2.27.11_PM_2.png

9.  If the missing content is coming from a twitter account, is the account sharing the same article repeatedly within a short period of time?  

If the twitter user is posting repeatedly the same article links within a short period of time, our system will halt pulling in all content from that twitter account.  Once the twitter user stops repeatedly sharing the same article link, our platform will begin pulling in the content again.  (User must wait a few days before content is automatically collected again).

Why do we have this rule in place?  Each time you share a link, we visit that site to scrape the info in order to present the title, content snippet and image. Repeatedly hitting a site to scrape data from an article can eventually bring a site down, similar to a DoS (Denial of Service) attack.

 

10. If your content from G+ is not showing up, check that the post is public.

Our system can only fetch public posts with a unique URL from G+ that match your keyword search. 

11.  Has the website or news sharer been blacklisted from your paper?

Go to your Paper Settings Dashboard, click Content > Advanced Settings,  scroll down and select Blacklisted people or Blacklisted websites to check that the missing URL or news sharer or website has not been (accidentally or not) blacklisted from your paper in the past.

12.  If the missing content is a video, has the "embed" setting been disabled?

Some videos from Youtube cannot be published through the Paper.li bookmarklet (such as http://www.youtube.com/watchfeature=player_detailpage&v=qq7fbMbJHsE).

If the owner of the video has requested that the video is not embeddable, then we will not be able to pull in the video to a paper.li.

To check if this is the case for the video you are trying to fetch, go to the the video in youtube.com, click "share" below the video, then "embed.  If the video says "embedding disabled by request", then we will not be able to pull in the video.

Screen_Shot_2014-02-06_at_3.57.35_PM_2.png

 

 

13.  Did the source (Twitter, G+, website) have technical issues?

A random technical issue cannot be ruled out as a culprit when we fetch content. From time to time "something" happens that prevents us from fetching content.  We have no control over outsides websites.

Check here for Twitter.

 

What should I do if none of these reasons apply to my case?

We are continually working on improving our web crawler to optimize how we pull content from the web.  If none of the above situations apply to you, we can investigate.  Tweet us at @paper_li with the following information:

(1) your paper URL,

(2) the edition date of the paper that had content missing, and

(3)    For Twitter: the URL of the tweet(s)* that were not included 

For G+, the URL that was not included.

For an RSS feed: the name of the RSS feed and the URL of the article which was not included

If using the bookmarklet: the URL which you are trying to add.

 

* To capture the URL of a tweet, click on the timestamp in the upper right hand corner of the tweet.  Copy the URL of the missing tweet to send to us.  

Tweet.png 

 

 

Was this article helpful?
3 out of 5 found this helpful
Have more questions? Submit a request

Comments

Powered by Zendesk