无法抓取完整页面(解决发红包感谢)

golinjoe

1.用该页面做的测试，移动端的页面：https://m.chinaproled.en.alibaba.com/
2.用万能框架无法读取，因为时间关系，并没有太多研究如何用万能框架访问

浏览器打开该页面

红色框中内容应该是后期添加的，但是如何添加的不清楚，如果是js添加，应该是不可能的，因为可以在源代码中查看到。

用代码方式抓取页面结果

代码抓取的页面代码

哪位大神帮我解决了，能抓取到产品列表，发红包感谢！

站长苏飞

我只是路过打酱油的。

竹林风

支持一下

站长苏飞

参考 这个就行了
http://www.sufeinet.com/thread-4270-1-1.html

Loman源

直接查看源文件就有了呀，说明不是js加载的数据

[HTML] 纯文本查看 复制代码

<div id="mod-related-product" class="block">
	<h2>Hot Products</h2>
	<ul class="clearfix">
														 
    		<li>
    			<a href="https://m.alibaba.com/product/60732344896/Amazon-Hot-Sale-LED-Tube-600mm.html">
												<img src="//sc01.alicdn.com/kf/HTB1qEBUhhuTBuNkHFNRq6A9qpXaJ/Amazon-Hot-Sale-LED-Tube-600mm-9W.jpg_120x120.jpg" />
					    				<span>Amazon Hot Sale LED Tube 600mm 9W 13W 16W 18W 20W 22W Lamp T8 LED Tube Light</span>
    			</a>
    		</li>
														 
    		<li>
    			<a href="https://m.alibaba.com/product/60585814254/A19-E27-E26-B22-5W-7W.html">
												<img src="//sc01.alicdn.com/kf/HTB1QdvIpER1BeNjy0Fmq6z0wVXaI/A19-E27-E26-B22-5W-7W-9W.jpg_120x120.jpg" />
					    				<span>A19 E27 E26 B22 5W 7W 9W 12W Brightest LED Light Bulbs Wholesale Soft White 3000K 4000K 6000K Light A60 led Bulb</span>
    			</a>
    		</li>
														 
    		<li>
    			<a href="https://m.alibaba.com/product/60676782024/High-lumen-LED-flood-light-IP65.html">
												<img src="//sc01.alicdn.com/kf/HTB1WE6jfKSSBuNjy0Flq6zBpVXaJ/High-lumen-LED-flood-light-IP65-projector.jpg_120x120.jpg" />
					    				<span>High lumen LED flood light IP65 projector 20w 50w 100w 300w outdoor multi-color RGB landscape lighting</span>
    			</a>
    		</li>
														 
    		<li>
    			<a href="https://m.alibaba.com/product/60492660118/LED-decorated-3-5-7-9.html">
												<img src="//sc02.alicdn.com/kf/HTB1bCcKSpXXXXb.XpXXq6xXFXXXl/LED-decorated-3-5-7-9-12.jpg_120x120.jpg" />
					    				<span>LED decorated 3/5/7/9/12/18W track light with black or white cover rail spot down lamp</span>
    			</a>
    		</li>
														 
    		<li>
    			<a href="https://m.alibaba.com/product/60676453932/IP67-Waterproof-5-Meters-16-4.html">
												<img src="//sc01.alicdn.com/kf/HTB1JuibSpXXXXXWXFXXq6xXFXXX5/IP67-Waterproof-5-Meters-16-4-Feet.jpg_120x120.jpg" />
					    				<span>IP67 Waterproof 5 Meters/16.4 Feet 3528 5050 SMD 395nm-405nm LED Black Lights UV/Ultraviolet Light Strip Fixtures Outdoor</span>
    			</a>
    		</li>
														 
    		<li>
    			<a href="https://m.alibaba.com/product/60712224884/UV-LED-Black-light-Tube-T5.html">
												<img src="//sc01.alicdn.com/kf/HTB1FOLTmZnI8KJjSsziq6z8QpXaO/UV-LED-Black-light-Tube-T5-18W.jpg_120x120.jpg" />
					    				<span>UV LED Black light Tube T5 18W Integrated UV LED Tube Light For Ultraviolet Curing DJ Party</span>
    			</a>
    		</li>
			</ul>
	<a href="/productlist.html" class="all-products-link more-link">
		View All Products
	</a>
</div>

Amy

我只是路过打酱油的。